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ABSTRACT 


Spectral-based  classification  schemes  designed  to  separate  various  wide  band 
transient  signals  in  added  noise  have  been  identified  and  their  performances 
compared  along  with  those  obtained  using  a  back-propagation  neural  network 
implementation.  The  spectral-based  measures  used  include:  the  normalized  cross- 
correlation  coefficient;  the  modified  normalized  cross-correlation  coefficient,  and; 
the  divergence  and  the  Bhattacharyya  distance.  Noise  was  added  to  the  signals 
to  create  signal  to  noise  ratios  of  0  dB  to  -20  dB.  Results  show  that  as  noise 
levels  increase,  the  modified  normalized  cross-correlation  coefficient  spectral 
measure  remains  the  most  robust  scheme. 


m 


TABLE  OF  CONTENTS 


L  INTOODUCnON _ 1 

n.  SPECTRAL  DISTANCE  MEASURES  AND  SPECTRAL 

CORRELATION  2 

A.  PROCESSING  OF  DATA  SETS . 2 

B.  SPECTRAL  MEASURES . 5 

1 .  Normalized  Cross-Ccxrelation  Coefficient . 6 

2.  Modified  Nixmalized  Cross-Ctmelation  Coefficient . 6 

3.  Bhattacharyya  Distance  [3] . 7 

4.  Divei^gence  (KuUback-Liebler  Number)  [3] . 8 

m.  SPECTRAL  DISTANCE-BASED  APPROACH. _ _ _ ........  10 

A  EXAMINATION  OF  TRANSIENT  TYPES . 10 

1.  The  Reference  Temi^ate . 10 

2.  Addition  of  Noise . 18 

B.  SPECTRAL-BASED  STUDY . 22 

1.  Noise-Free  Analysis . 22 

2.  Signal  Plus  Noise  Analysis . 2  8 

a.  Single  Run . 28 

•  b.  Multiple  Runs . 37 

IV.  NEURAL  NETWORK  STUDY _ 44 

A  NEURAL  NETWORK  IMPLEMENTATION . 45 

1.  Single  Run . 45 

2.  Multiple  Runs . 50 

V.  SOFTWARE  IMPLEMENTATION _ 52 

A  NEURALWORKS  PROFESSIONAL  II/PLUS™ . 52 

B.  MATLAB®  SOFTWARE  IMPLEMENTATION . 52 

1.  Program  DIST.M  [11 . 53 

2.  Program  LOFAR.M[l] . 53 


IV 


VL  SUMMARY  AND  RECOMMENDATIONS - - - - 54 

A.  SUMMARY . 54 

B.  RECOMMENDATIONS . 55 

REFERENCES _ 57 

APPENDIX  A.  INDIVIDUAL  SPECTRAL  MEASURES _ 58 

APPENDIX  B.  NEURAL  NETWORK  RESULTS _ 89 

A.  NEURAL  NETWORK  RESULTS  USING  DB  SPECTRAL 

COEFHCIENTS . 89 

B.  NEURAL  NETWORK  RESULTS  USING  SPECTRAL 

COEFFICIENTS . 98 

C  "SNAPSHOT"  OF  NEURAL  NETWORK . 107 

APPENDIX  C.  MATLAB®  CODE  IMPLEMENTATION _ 111 

A.  SINGLE  RUN  PROGRAMS . Ill 

B.  MULTIPLE  RUN  PROGRAMS . 118 

C  NEURAL  NETWORK  INPUT  PROGRAMS . 145 


INITIAL  DISTRIBUTION  LIST 


™148 


V 


LIST  OF  TABLES 


Table  3.1:  LOG  /  SCALE  FACTOR  CHART . 18 

Table  4.1  A:  NEURAL  NETWORK  TRAINING  USING  10*LOG10 

RULE . 45 

Table  4.1B:  NEURAL  NETWORK  TRAINING  USING  10*LOG10 

RULE . 46 

Table  4.2:  AVERAGE  VALUES  FROM  SINGLE  NN  TESTING  RUN . 48 

Table  4.3:  AVERAGE  VALUES  FROM  100  CONSECUTr.T  NN 

TESTING  RUNS . 50 

B.l:  X1_0DB  TEST  RUN  USING  DB  COEFFICIENTS . 87 

B.2:  XIJ-IDB)  TEST  RUN  USING  DB  COEFHCIENTS . 88 

B.3:  X1_(-2DB)  TEST  RUN  USING  DB  COEFFICIENTS . 88 

B.4:  X1_(-3DB)  TEST  RUN  USING  DB  COEFnCIENTS . 89 

B.5:  X1_(-4DB)  TEST  RUN  USING  DB  COEFFICIENTS . 89 

B.6:  X1J-5DB)  TEST  RUN  USING  DB  COEFHCIENTS . 90 

B.7:  XIJ-IODB)  TEST  RUN  USING  DB  COEFHCIENTS . 90 

B.8:  X1_(-15DB)  TEST  RUN  USING  DB  COEFHCIENTS . 91 

B.9:  X1J-20DB)  TEST  RUN  USING  DB  COEFFICIENTS . 91 

B.  10;  X2_(0DB)  TEST  RUN  USING  DB  COEFHCIENTS . 92 

B.l  1;  X2_(-1DB)  TEST  RUN  USING  DB  COEFHCIENTS . 92 

B.12:  X2_(-2DB)  TEST  RUN  USING  DB  COEFHCIENTS . 92 

B.  1 3:  X2_(-3DB)  TEST  RUN  USING  DB  COEFHCIENTS . 93 

B.14;  X2_(-4DB)  TEST  RUN  USING  DB  COEFHCIENTS . 93 

B.15:  X2_(-5DB)  TEST  RUN  USING  DB  COEFHCIENTS . 93 

B.16:  X2_(-10DB)  TEST  RUN  USING  DB  COEFHCIENTS . 94 

B.17:  X2_(-15DB)  TEST  RUN  USING  DB  COEFFICIENTS . 94 

B.18;  X2_(-20DB)  TEST  RUN  USING  DB  COEFHCIENTS . 94 

B.19:  AVERAGE  FOR  ALL  RUNS  USING  DB  COEFHCIENTS . 95 

B.20:  XIJODB)  TEST  RUN . 96 

B.21:  XIJ-IDB)  TEST  RUN . 97 

B.22:  X1_(-2DB)  TEST  RUN . 97 

B.23:  X1_(-3DB)  TEST  RUN . 98 

vi 


B.24:  X1_(-4DB)  TEST  RUN . 98 

B.25:  X1_(-5DB)  TEST  RUN . 99 

B.26:  X1_(-10DB)  TEST  RUN . 99 

B.27:  X1_(-15DB)  TEST  RUN . 100 

B.28:  X1_(-20DB)  TEST  RUN . 100 

B.29:  XIJODB)  TEST  RUN . 101 

B.30:  X2_(-1DB)  TEST  RUN . 101 

B.3 1 :  X2_(-2DB)  TEST  RUN . 101 

B.32:  X2_(-3DB)  TEST  RUN . 102 

B.33:  X2_(-4DB)  TEST  RUN . 102 

B.34:  X2_(-5DB)  TEST  RUN . 102 

B.35:  X2_(-10DB)  TEST  RUN . 103 

B.36;  X2_(-15DB)  TEST  RUN . 103 

B.37:  X2_(-20DB)  TEST  RUN . 103 

B.38:  AVERAGE  FOR  ALL  RUNS  USING  SPECTRAL 

COEFHCIENTS . 104 


vii 


LIST  OF  FIGURES 


Figure  2. 1 :  Typical  Transient  Type . 3 

Figure  2.2:  1020  Point  Transients . 3 

Figure  2.3:  Spectral  Plot  EXCA200: 1  and  Contour  Plot  for 

EXCA220 . 4 

Figure  2.4:  Supeiposition  All  Sets  of  Spectral  Coefficients  in  XI . 4 

Figure  2.S:  Spectral-Based  Measures  Using  Xlt  and  XI . 9 

Figure  2.6:  Spectral-Based  Measures  Using  Xlt  and  X2 . 9 

Figure  3.1:  Time  vs.  Amplitude  Plots  fOT  EXCA200  and  EXCA210 . 1 1 

Figure  3.2:  Time  vs.  Amplitude  Plots  for  EXCA220  and  EXCA230 . 1 1 

Figure  3.3  :  Transient  Classification  in  the  Time  Domain  for  EXCA200: 1 , 

EXCA210:1,  EXCA230:1  and  EXCA220:1 . 13 

Figure  3.4:  Spectra  ftM*  Transients  EXCA210  and  EXCA220 . 14 

Figure  3.5:  Spectra  few-  Transients  EXCA200  and  EXCA230 . 14 

Figure  3.6:  Supeiposition  of  All  Spectral  Coefficients  Used  in  Template 

Xlt . 15 

Figure  3.7:  Supeiposition  of  All  Spectral  Coefficients  Used  in  Template 

X2t . 15 

Figure  3.8:  Superposition  of  All  Spectral  Coefficients  Used  in  Template 

X3t . 16 

Figure  3.9:  Spectral  InfcHination  for  sets  EXCA200  and  EXCA210 . 17 

Figure  3.10:  Spectral  Infinmation  for  sets  EXCA220  and  EXCA230 . 17 

Figure  3.11:  Signal  Flow  Diagram . 19 

Figure  3.12:  SNR  Values  of  0  dB  Through  -3  dB  for  EXCA200  . 20 

Figure  3.13:  SNR  Values  of  -4  dB  Through  -15  dB  for  EXCA200 . 21 

Figure  3.14:  XI  with  SNRs  of  0  dB  Through  -3  dB . 21 

Figure  3.15:  XI  with  SNRs  of -4,  -5,  -10,  -15  dB . 22 

Figure  3.16:  Spectral  Measure  Results  for  Xlt  Versus  XI . 24 

Figure  3.17:  Spectral  Measure  Results  for  X2t  Versus  X2 . 25 

Figure  3.18:  Spectral  Measure  Results  for  X3t  Versus  X3 . 25 

Figure  3.19:  Spectral  Measure  Results  for  Xlt  Versus  X2 . 26 


Figure  3.20:  Spectral  Measure  Results  for  XI  t  Versus  X3 . 26 

Figure  3.21 :  Spectral  Measure  Results  for  X2t  Versus  XI . 27 

Figure  3.22:  Spectral  Measure  Results  fw  X2t  Versus  X3 . 27 

Figure  3.23:  Cross-C(MTelation  Measure  Results  fcM*  Xlt,  X2t  and  X3t  as 

Compared  to  XI J,  X2J,  and  X3J  Respectively,  Averaged 
for  1  Run . 30 

Figure  3.24:  Cross-Correlation  (mean  removed)  Measure  Results  fen*  XI  t, 

X2t  and  X3t  as  Compared  to  XI  J,  X2J,  and  X3J 
Respectively,  Averaged  for  1  Run . 30 

Figure  3.2S:  Bhattacharyya  Measure  Results  for  Xlt,  X2t  and  X3t  as 

Compared  to  XI  J,  X2J,  and  X3J  Respectively  Averaged 

for  1  Run . 31 

Figure  3.26:  Divergence  Measure  Results  for  Xlt,  X2t  and  X3t  as 

Compared  to  XI  J,  X2J,  and  X3J  Respectively,  Averaged 

for  1  Run . 31 

Figure  3.27:  Cross-Correlation  Measure  Results  for  Xlt  ^  Compared  to 

XI  J,  X2J,  and  X3 J  Respectively,  Averaged  for  1  Run . 32 

Figure  3.28:  Cross-Correlation  (mean  removed)  Measure  Results  for  Xlt 
as  Compared  to  XI  J,  X2J,  and  X3 J  Respectively, 

Averaged  for  1  Run .  32 

Figure  3.29:  Bhattacharyya  Measure  Results  for  Xlt  as  Compared  to  XI  J, 

X2 J,  and  X3 J  Respectively,  Averaged  for  1  Run . 33 

Figure  3.30:  Divergence  Measure  Results  for  Xlt  as  Compared  to  XI  J, 

X2 J,  and  X3 J  Respectively  Averaged  for  1  Run . 33 

Figure  3.31:  Cross-Conelation  Measure  Results  for  X2t  as  Compared  to 

XI  J,  X2J,  and  X3J  Respectively  Averaged  for  1  Run . 34 

Figure  3.32:  Cross-Correlation  (mean  removed)  Measure  Results  for  X2t 
as  Compared  to  XI  J,  X2J,  and  X3 J  Respectively  Averaged 
for  1  Run . 34 

Figure  3.33:  Bhattacharyya  Measure  Results  for  X2t  as  Compared  to  X 1 

X2 J,  and  X3  J  Respectively  Averaged  for  1  Run . 35 

Figure  3.34:  Divergence  Measure  Results  for  Xlt,  X2t  and  X3t  as 

Compared  to  XI  J,  X2J,  and  X3 J  Respectively  Averaged 

for  1  Run . 35 

Figure  3.35:  Cross-Correlation  Results  for  Xlt,  X2t  and  X3t  versus  XI  J, 

X2J,  and  X3 J  Respectively  (Averag^  for  100  Runs) . 38 


IX 


Figure  3.36:  Cross-Correlation  (mean  removed)  Measure  Results  for  Xlt, 

X2t  and  X3t  versus  XI J,  X2J,  and  X3J  Respectively 
(Averaged  fcff  1(X)  Runs) . 38 

Figure  3.37:  Bhattacharyya  Results  for  Xlt,  X2t  and  X3t  versus  XI  J, 

X2j,  and  X3 J  Respectively  (Averaged  for  1(X)  Runs) . 39 

Figure  3.38:  Divergence  Results  for  Xlt,  X2t  and  X3t  versus  XI  J,  X2J, 

and  X3J  Respectively  (Averag^  fw  100  Runs) . 39 

Figure  3.39:  Cross-Correlation  Results  for  Xlt  versus  XI  J,  X2_j,  and 

X3j  Respectively  (Averaged  for  100  Runs) . 40 

Figure  3.40:  Cross-Correlation  (mean  removed)  Results  for  Xlt  versus 

XI  J,  X2J,  and  X3J  Respectively  (Averaged  for  100  Run.s) . 40 

Figure  3.41 :  Bhattacharyya  Results  for  Xlt  versus  XI  J,  X2_j,  and  X3  J 

Respectively  (Averaged  for  100  Runs) . 41 

Figure  3.42:  Divergence  Results  for  Xlt  versus  Xl_j,  X2J,  and  X3J 

Respectively  (Averaged  for  100  Runs) . 41 

Figure  3.43:  Cross-Correlation  Results  for  X2t  versus  XI  J,  X2J,  and 

X3J  Respectively  (Averaged  for  100  Runs) . 4- 

Figure  3.44:  Cross-Correlation  (mean  removed)  Results  for  X2t  versus 

XI  J,  X2J,  and  X3J  Respectively  (Averaged  for  100  Runs) . 42 

Figure  3.45:  Bhattacharyya  Results  for  X2t  versus  Xl_j,  X2J,  and  X3 J 

Respectively  (Averaged  for  100  Runs) . 43 

Figure  3.46:  Divergence  Results  for  Xlt,  X2t  and  X3t  versus  XI  J,  X2J, 

and  X3J  Respectively  (Averaged  for  100  Runs) . 43 

A.l:  Xlt  correlated  against  XI . 57 

A.2:  Xlt  correlated  against  X1_0  dB . 58 

A.3:  Xlt  correlated  against  Xl_(-ldB) . 58 

A.4:  Xlt  correlated  against  Xl_(-2dB) . 59 

A.5:  Xlt  correlated  against  X l_(-3dB) . 59 

A.6:  Xlt  correlated  against  Xl_(-4dB) . 60 

A.7:  Xlt  correlated  against  Xl_(-5dB) . 60 

A.8:  Xlt  correlated  against  Xl_(-10dB) . 61 

A.9:  Xlt  correlated  against  Xl_(-15dB) . 61 

A.  10:  Xlt  correlated  against  X l_(-20dB) . 62 

A.l  1:  Xlt  correlated  against  X2 . 62 

A.12:  Xlt  correlated  against  X2_(0dB) . 63 


X 


A.13:  Xlt  correlated  against  X2_(-ldB) . 63 

A.  14:  Xlt  cwrelated  against  X2_(-2dB) . 64 

A.15:  Xlt  correlated  against  X2_(-3dB) . 64 

A.  16:  Xlt  ctwrelated  against  X2_(-4dB) . 65 

A.17:  Xlt  COTrelated  against  X2_(-5dB) . 65 

A.18:  Xlt  c<»related  against  X2_(-10dB) . 66 

A.19:  Xlt  correlated  against  X2_(-15dB) . 66 

A.20:  Xlt  correlated  against  X2_(-20dB) . 67 

A.21 :  Xlt  correlated  against  X3 . 67 

A.22:  Xlt  correlated  against  X3_0dB . 68 

A.23:  Xlt  correlated  against  X3_(-ldB) . 68 

A.24:  Xlt  correlated  against  X3_(-2dB) . 69 

A.25:  Xlt  correlated  against  X3_(-3dB) . 69 

A.26:  Xlt  correlated  against  X3_(-4dB) .  70 

A.27:  Xlt  correlated  against  X3_(-5dB) . 70 

A.28:  Xlt  correlated  against  X3_(-10dB) . 71 

A.29:  Xlt  correlated  against  X3_(-l 5dB) . 71 

A.30:  Xlt  correlated  against  X3_(-20dB) . 72 

A.3 1 :  X2t  correlated  against  X2 . 72 

A.32:  X2t  correlated  against  X2_(0dB) . 73 

A.33:  X2t  correlated  against  X2_(-ldB) . 73 

A,34:  X2t  correlated  against  X2_(-2dB) . 74 

A.35 :  X2t  correlated  against  X2_(-3dB) . 74 

A.36:  X2t  correlated  against  X2_(-4dB) . 75 

A.37 :  X2t  correlated  against  X2_(-5dB) . 75 

A.38:  X2t  correlated  s^ainst  X2_(-10dB) . 76 

A,39:  X2t  correlated  against  X2_(- 1 5dB) . 76 

A.40:  X2t  correlated  against  X2_(-20dB) . 77 

A.41 :  X2t  correlated  against  X3 . 77 

A,42:  X2t  correlated  against  X3_(0dB) . 78 


XI 


A.43:  X2t  crarelated  against  X3_(-  IdB) . 78 

A.44:  X2t  ctxrelated  against  X3_(-2dB) . 79 

A.45:  X2t  correlated  against  X3_(-3dB) . 79 

A.46:  X2t  ctHielated  against  X3_(-4dB) . 80 

A.47 :  X2t  correlated  against  X3_(-5dB) . 80 

A.48:  X2t  ccmrelated  against  X3_(-10dB) . 81 

A.49:  X2t  correlated  against  X3_(-15dB) . 81 

A.50:  X2t  correlated  against  X3_(-20dB) . 82 

A.51 :  X3t  correlated  against  X3 . 82 

A.52:  X3t  correlated  against  X3_(0dB) . 83 

A.53:  X3t  correlated  against  X3_(- IdB) . 83 

A.54:  X3t  ccMrelated  against  X3_(-2dB) . 84 

A.55 :  X3t  correlated  against  X3_(-3dB) . 84 

A.56:  X3t  correlated  against  X3_(-4dB) . 85 

A.57:  X3t  correlated  against  X3_(-5dB) . 85 

A.58:  X3t  correlated  against  X3_(- lOdB) . 86 

A.59:  X3t  correlated  against  X3_(-l 5dB) . 86 

A. 60:  X3t  correlated  against  X3_(-20dB) . 87 

B. 39:  Neural  Nctworic  Training  Setup . 106 

B.40;  Neural  Network  Training  in  Process . 107 

B.41 :  Trained  Neural  Network  using  dB  Coefficients . 108 

B. 42:  Trained  Neural  Netwoik  using  Spectral  Coefficients . 109 

C.  1 :  Program  no_noise  LOFAR.M  [1  ] . 110 

C.2:  Program  noisy_LOFAR.M  [  1  ] . Ill 

C.3:  Program  DIST.M  [1] . 1 13 

C.4:  Function  Noisy_Sig.M . 115 

C.5;  Function  Noisy_Xl_fcn,M . 116 

C.6:  Function  Noisy _X2_fcn.M . 1 17 

C.7:  Function  Noisy_X3_fcn.M . 117 

C.8:  Program  BIG.M . 117 

C.9:  Program  BIG_adder_clear.M . 1 1 8 


xii 


CIO;  Program  BIG_band2_plots.M . 1 19 

C.  1 1 :  Program  BIG.summer.M . 122 

C.  1 2:  Program  BIG_var_save.M . 124 

C.13:  Program  BIG.average.M . 125 

C.  14:  Program  BIG_plots.M . 126 

C.15;  Program  NN_Setup.M  [8] . 144 


ACKNOWLEDGMENTS 


In  appreciation  of  their  time,  effort,  and  patience,  I  would  like  to  thank  my 
instructors,  advisors,  and  the  staff  and  faculty  of  Electrical  &  Computer 
Engineering  Department,  NFS.  In  addition,  many  thanks  go  to  my  fellow  students 
with  whom  I  spent  long  hours  in  class,  in  the  office  and  in  the  library  learning 
much  more  than  what  was  taught  in  class. 

Special  thanks  to  my  advisors  Dr.  Ralph  Hippenstiel  and  Dr.  Monique 
Fargues  for  the  opportunity  to  do  this  research  as  well  as  their  support,  guidance, 
and  encouragement  as  I  learned. 

Finally,  I  would  like  to  thank  my  lovely  wife,  whose  unwavering  love  and 
confidence  were  a  constant  source  of  strength  and  inspiration.  Thank  you 
Melinda. 


xiv 


I.  INTRODUCTION 


Classiflcation  of  various  wideband  transient  signals  have  extensibly  been 
accomplished  using  neural  netwoiks  (NN).  Unfortunately,  poor  performance  is 
attained  if  the  neural  network  is  trained  with  small  training  sets.  In  mder  to  relieve 
training  and  computational  time,  four  spectral  measures  using  spectral  coefficients 
are  applied  to  correlate  data  sets  suf^lied  by  the  spcMisor  with  a  template  derived 
from  the  classification  of  all  data  sets  into  three  different  groups  of  spectral 
coefficients.  The  goal  of  this  research  is  to  investigate  the  robustness  of  the 
spectral-based  measures  when  white  Gaussian  noise  is  added  to  the  transients 
under  study. 

First,  all  data  sets  are  classified  as  in  the  original  study  and  the 
correlation  algorithms  are  verified  [1].  White  Gaussian  noise  is  then  added  to  each 
signal  to  create  signal  to  noise  ratios  (SNR)  of  0  dB  to  -20  dB.  The  resultant  set  of 
spectral  coefficients  is  correlated  with  a  user  specified  spectral  template.  Each 
spectral  distance  measure  is  calculated  using  one  of  four  correlation  algorithms. 
The  results  are  plotted  to  determine  which  algorithm  has  the  most  robust 
performance  as  noise  is  added.  Next,  a  NN  implementation  is  used  to  determine  its 
performance  in  a  noisy  environment.  A  tabular  representation  of  the  results  is 
presented. 

Chapter  II  details  the  spectral  distance  measures  and  correlation 
approaches,  while  Chapter  III  discusses  related  processing  results.  Next,  Chapters 
IV  and  V  cover  the  NN  approach  and  related  results.  Finally,  Chapter  VI 
summarizes  the  work  and  addresses  areas  of  further  research. 
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II.  SPECTRAL  DISTANCE  MEASURES  AND  SPECTRAL 

CORRELATION 


A.  PROCESSING  OF  DATA  SETS 

Typical  transient  signals  are  presented  in  Figure  2.1  and  Figure  2.2.  These 
signals  are  functions  of  time  and  are  digitized  fm*  processing.  The  length  of  each 
signal  is  1020  data  points.  Spectral  coefficients  can  easily  be  obtained  by  taking 
the  Fast  Fourier  Transform  (FFT)  of  the  digitized  data  and  extracting  the 
magniuide  squared  of  the  coefficients  at  the  locations  of  interest  once  the  signals 
have  been  zero-padded  to  lengths  equal  to  1024  points  [1].  Plotting  the  spectral 
coefficients  shows  that  the  information  is  contained  in  the  first  64  spectral 
locations. 

Once  the  spectral  coefficients  are  calculated  and  plotted,  each  is  visually 
inspected  and  sorted  into  like  sets.  Similar  transients  in  a  train  are  grouped  with 
other  transients  from  either  the  same  train  or  other  trains.  Figure  2.3  plots  the 
frequency  coefficient  vs.  power  and  frequency  coefficient  vs.  signal  locatirm  to 
further  classify  each  transient.  The  spectral  coefficients  determined  to  belong  to 
one  group  are  averaged  together  to  obtain  a  spectral  template  representing  a 
particular  signal  group  of  interest.  Motc  robust  results  are  obtained  when  a  signal 
template  is  represented  by  many  signals  of  the  same  group.  Figure  2.4  represents 
a  typical  grouping  of  several  sets  of  spectral  coefficients  into  one  set  known  as 
XI. 
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Figure  23:  Spectral  Plot  for  EXCA200:1  and  Contmir  Rot  for 
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Figure  2.4:  Superposition  All  Sets  of  Spectral  Coefficients  in  XI 
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B.  SPECTRAL  MEASURES 


Upon  calculation  of  a  template  set,  a  decision  is  made  whether  (»-  not  the  test 
signals  belong  to  the  set  of  spectral  coefficients  that  created  the  template.  This  is 
determined  by  measuring  the  degree  of  similarity  between  the  spectral  density 
values.  The  four  spectral  measures  chosen  for  the  study  are: 

1. )  Normalized  cross-correlation  coefficient, 

2. )  Moditied  cross-correlation  coefficient, 

3. )  Bhattacharyya  distance, 

4. )  Divergence. 

With  the  spectral  measures  chosen,  the  Hrst  step  in  the  signal  processing 
sequence  is  to  calculate  the  magnitude  squared  Fourier  coefficients  for  the  first  64 
spectral  locations.  The  magnitude  squared  form  of  the  Fourier  transform  is  given 
by  the  equation  [1]  [2]: 


/».(»)' 


1023  hi 

Z  x(,)e  ^^*1024 


n=0 


for  *  =  0,1...63  . 


A  rectangular  window  is  employed  in  this  study;  however,  it  would  be  a 
simple  modification  to  include  any  other  data  window.  Some  preliminary  results 
using  a  Hamming  data  window  did  not  show  a  significant  difference  with  those 
obtained  using  the  rectangular  window.  The  inclusion  of  a  window  necessitates 
an  additional  1020  point  multiply  per  signal  tested  which  increases  the  processing 
time.  One  open  question  is  still  the  effect  of  windows  when  noise  is  present.  The 
problem  in  general,  is  finding  the  degree  of  relatedness  between  the  template  and 
test  vector  and  an  appropriate  threshold. 
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L  Nomnliied  Cross-CorrelatkMi  Coeflkieiit 

The  first  distance  measure  scheme  incremented  is  the  normalized  cross- 
correlation  coefficient.  This  approach  involves  cross  correlating  two  vectors  and 
normalizing  the  coefficients  by  the  square  root  of  the  product  o(  the  auto  powm. 
The  output  yields  a  value  between  zero  and  positive  one.  A  value  of  one 
corresponds  to  a  100%  match  between  two  vectws,  a  value  of  zero  cwresptMids 
to  no  match  between  the  two  vectors.  The  cross  correlation  expression  is  given 
by: 


I  r9  , 


Individual  spectral  measure  results  using  the  cross  conelation  coefficient 
are  shown  in  the  upper  left-hand  comer  of  Figures  2.5  and  2.6.  Figure  2.5  shows 
a  high  degree  of  correlation  between  the  XI  template  and  each  set  of  spectral 
coefficients  which  make  up  that  template.  However,  Figure  2.6  shows  low 
correlation  values,  meaning  that  the  XI  template  is  not  related  to  the  set  X2. 

2.  Modified  Normalized  Cross-Correlation  Coefficient 

The  modified  normalized  cross-correlation  coefficient  is  virtually 
identical  to  the  normalized  cross-correlation  coefficient  with  one  important 
change.  The  mean  value  is  removed  from  the  template  and  test  vector  prior  to 
correlation.  This  produces  a  sample  mean  of  zero  for  each  vector  (i.e.  DC 
component  is  zero).  The  range  of  values  are  intuitively  pleasing:  minus  one  to 
positive  one.  These  ranges  are  preferable  since  distinguishing  between  sets  is 
easier.  For  signals  belonging  to  different  sets,  the  correlation  coefficients  are 


6 


typically  smaller,  while  cmelation  coefficients  of  signals  belonging  to  the  same 
set  generally  remain  the  same.  Fot  automatic  classification  this  method  is  both 
easier  and  more  robust  than  other  methods  since  the  separaticm  between  unlike 
sets  tends  to  be  larger.  The  results  fcM*  no-noise  and  for  noisy  environments  also 
indicate  this  method  of  classification  as  the  best  technique.  Typical  ccxrelaticm 
results  are  shown  in  the  upper  right-hand  comer  of  Figures  2.S  and  2.6. 

3.  Bhattacharyya  Distance  [3] 

Spectral  densities  can  be  converted  into  probability  density  functitms 

(pdf)  by  normalizing  the  densities  so  that  they  have  unit  area.  Information 

pertaining  to  the  total  power  is  lost,  but  all  other  information  remains.  Utilizing 
these  pdfs,  the  Bhattacharyya  distance  can  be  applied.  Defining  p^{ )  and  Py( ) 

as  pdfs,  the  Bhattacharyya  distance  is  given  by: 


Bw-  \^pjfypjm 
for  the  continuous  case,  or 


t>0 

for  the  discrete  case. 

If  the  two  densities  do  not  overlap,  then  is  essentially  zero- 
However,  if  the  densities  are  identical,  Bxr  approaches  one.  Therefore,  the 
Bhattacharyya  Distance  is  a  measure  bounded  by  zero  and  one.  Typical  results 
are  shown  in  the  lower  left-hand  comer  of  Figures  2.5  and  2.6. 
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4.  Divergence  (KnIIbnck-Liebler  Number)  [3] 

This  measure  utilizes  the  pdf  obtained  from  the  normalized  spectral 
densities.  The  divergence  is  defined  as : 


in  the  continuous  case  and 


63 

D«-I 

6-0 


p,(*) 


6-0 


pAk) 


p,m 


in  the  discrete  case. 


If  p^(  )  equals  p^(  ),  the  divergence  approaches  zero.  However,  if  the  two 

density  functions  differ,  then  the  divergence  increases  to  become  a  large  positive 
number.  A  determination  of  a  usable  threshold  is  difficult  when  using  this 
measure.  Typical  processing  of  results  are  shown  in  the  lower  right-hand  comer 
of  Figures  2.5  and  2.6. 
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IIL  SPECTRAL  DISTANCE-BASED  APPROACH 


Four  different  transient  signal  sets  are  studied  in  this  research.  They  are: 
EXCA200,  EXCA210.  EXCA220  and  EXCA230. 

As  introduced  in  Chapter  II,  each  signal  set  consists  of  several  transients. 
Some  transient  sets  are  sampled  at  a  slightly  slower  rate  than  others,  thereby 
necessitating  an  operation  to  equalize  all  sanq>ling  rates  to  allow  for  comparison. 
The  sampling  frequency  for  set  EXCA200  is  5.12  lO^^  Hz,  while  transient  sets 
EXCA210,  220  and  230  are  sampled  at  2.048  lO^^Hz.  A  resampled  set  of 
transients  is  produced  when  the  original  sampling  rate  does  not  conform  with  the 
one  used  for  set  EXCA200.  To  obtain  SNR  levels  from  0  dB  to  -20  dB,  noise  is 
added  to  each  transient  within  a  set  to  test  the  performance  of  all  four  spectral 
measures  as  well  as  the  NN. 

The  convention  used  to  identify  individual  transients  within  a  set  is  by 
designating  the  raw  data  file  followed  by  each  transient  number  (i.e. 
EXCA210: 1,3-6  equates  to  file  EXCA210,  transients  1,3,4 ,5  and  6).  The  terms  Xi, 
Xit  and  XiJ  (where  i=l,2,3  and y=0,..,-5,  -10,  -15,  -20),  refer  to  the  set  of  spectral 
coefHcients  composing  the  Xi  template,  the  Xi  template  itself  and  the  set  Xi 
degraded  to  have  SNR  levels  which  vary  from  0  to  -20  dB. 

A.  EXAMINATION  OF  TRANSIENT  TYPES 
1.  The  Reference  Template 

Time  plots  for  all  transients  are  shown  in  Figures  3.1  and  3.2.  Note  that 
each  file  of  type  EXCAXXX  contains  several  transients  of  length  1020. 
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Figure  3.2:  Time  vs.  Amplitude  Plots  for  EXCA220  and  EXCA230 


The  reference  template  is  an  averaged  set  of  spectral  coefficients 
produced  by  combining  spectral  coefficients  obtained  using  similar  transients 
from  the  data  sets  considered.  Files  EXCA210,  220  and  230  are  sampled  at  a 
lower  rate  than  EXCA200.  In  order  to  insure  meaningful  results,  a  uniform 
sampling  rate  is  required.  The  sampling  rate  for  EXCA210,  220  and  230  is  slower 
by  a  factor  of  2.S  compared  to  the  rate  of  file  EXCA200.  Therefore  to  compensate 
for  this  change,  the  first  408  points  are  considered  for  transients  within  sets 
EXCA210,  220  and  230.  After  truncation  to  the  first  408  samples,  a  "factor  of 
five"  interpolation  and  a  "factor  of  two"  decimation  scheme  are  applied  to  bring 
the  transient  length  back  to  1020  points  following  the  procedures  given  in  [1]. 
This  interpolation/decimation  scheme  allows  the  use  of  all  transients  given  in  the 
study. 

The  template  construction  involves  an  examination  of  time  and 
frequency  behavior  for  each  transient.  Figure  3.1  shows  that  set  EXCA200  has 
three  transients  which  have  similar  characteristics.  When  each  raw  data  set  is 
examined  closely  in  the  time  domain,  more  similarities  become  obvious.  Figure  3.3 
shows  the  similarities  between  EXCA200:1  and  EXCA230:1  o\  er  1020  and  508 
points  respectively.  EXCA220:1  however,  is  entirely  different  from  EXCA200:1, 
EXCA210:1  and  EXCA230:1  and  is  thus  classified  into  a  separate  category. 
When  all  transients  are  examined  within  each  raw  data  set,  visual  similarities 
become  obvious  and  partial  classifications  follow. 
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Figure  3  J  :  Transient  Classifik»tion  in  the  Time  Domain  for 

EXCA200:1,  EXCA210:1,  EXCA230:1  and  EXCA220:1 


Classification  is  continued  in  the  frequency  domain  to  obtain  spectral 
coefficients  for  further  processing.  Figures  3.4  and  3.5  show  spectral  similarities 
between  transient  sets  EXCA210,  EXCA220,  EXCA200  and  EXCA230.  Spectral 
coefficient  sets  EXCA210: 1,3-6,  EXCA230:1 -3,5-9  and  EXCA200:l-3  are 
grouped  into  one  file  called  XI  shown  in  Figure  3.6.  The  average  of  file  XI  is 
used  to  compose  the  first  template  known  as  Xlt.  Spectral  coefficients  in  set 
EXCA220:1 -2,4-6  are  similar  and  unique  and  are  all  grouped  into  one  file  called 
X2  shown  in  Figure  3.7.  Their  resulting  average  is  used  to  create  the  second 
template  known  as  X2t.  Finally,  spectral  coefficient  sets  EXCA210:2, 
EXCA220:3,  EXCA230:4,10-13  are  not  similar  to  any  other  spectral  coefficient 
sets  and  are  grouped  into  set  X3.  The  X3  set  is  known  as  the  "everything  else"  set 
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[1]  and  is  shown  in  Figure  3.8.  The  resulting  avo^e  is  used  to  created  the  last 
tonplate  known  as  X3t. 
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Figure  3.4:  Spectra  for  Transients  EXCA210  and  EXCA220 
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Figure  3.5:  Spectra  for  Transients  EXCA200  and  EXCA230 
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Figure  3.6:  Superposition  of  All  Spectral  Coefficients  Used  in  Template 

Xlt 


Figure  3.7:  Superposition  of  All  Spectral  Coefficients  Used  in  Template 

X2t 
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Figure  3^:  Superposition  of  All  Spectral  Coefficients  Used  in  Template 

X3t 


Figures  3.9  and  3.10  are  additional  classification  aid  examples  of 
information  contained  in  the  frequency  domain.  The  upper  left  side  of  Figure  3.9 
demonstrates  superimposed  spectra  corresponding  to  each  of  the  spectral 
coefficient  sets  in  EXCA200.  The  upper  right  side  of  the  Figure  3.9  shows 
ccmtour  plots  of  the  same  spectra.  Note  that  all  coefficient  sets  in  the  upper  half  of 
the  Figure  3.9  are  identical  (a  fact  already  apparent  in  the  time  domain  plots).  The 
lower  half  of  Figures  3.9  and  3.10  display  quite  a  different  scenario.  The  bottcnn 
plots  in  Figure  3.9  represent  frequency  information  for  each  transient  in  set 
EXCA210.  The  contour  plot  allowed  us  to  determine  that  EXCA210:2  is  different 
from  all  other  transients  in  that  signal.  Observing  the  top  half  of  Figure  3.9  for 
EXCA200  it  becomes  apparent  that  all  spectral  coefficient  sets  in  transient  set 
EXCA210  (with  the  exception  of  EXCA210:2)  and  all  transient  sets  in  EXCA200 
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Spectnim  Speclnim 


are  very  similar.  Reviewing  the  lower  half  of  Figure  3.10  which  refmsents 
transient  set  EXCA230,  it  becomes  ^>parent  that  EXCA230:1 -3,5-9  are  similar  to 
EXCA200:l-3.  These  spectral  coefficient  sets  are  grouped  into  file  XI. 
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Figure  3.9:  Spectral  Informatioii  for  sets  EXCA200  and  EXCA210 
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Figure  3.10:  Spectral  Information  for  sets  EXCA220  and  EXCA230 
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A  similar  process  is  used  to  detennine  the  remaining  groups.  Transioits 
EXCA220: 1 ,2,4-6  constitute  group  X2  as  shown  in  Figure  3.7.  Finally,  after 
review  of  all  remaining  sets  of  spectral  coefficients,  the  last  group  consists  of 
EXCA210.2,  EXCA220:3  and  EXCA230:4.10-13  and  is  labeled  X3,  shown  in 
Figure  3.8.  Recalling  that  the  information  is  also  contained  in  the  time  domain 
plots,  oat  can  use  either  or  both  methods  for  classification. 

2.  Addition  of  Noise 

The  main  thrust  of  this  study  is  to  determine  the  perftnmance  of  the  four 
spectral  measure  algtxithms  introduced  earlier  on  a  known  set  of  signals  with 
varying  amounts  of  added  white  Gaussian  noise.  The  resulting  SNRs  of  the  noisy 
transient  considered  are  between  -20  dB  and  0  dB.  Note  that  the  added  noise 
may  not  be  the  only  noise  inesent.  The  raw  data  sets  may  already  contain  small 
amounts  of  noise  thereby  effectively  (tecreasing  the  SNR  value  to  an  even  lower 
ratio.  Therefore,  the  added  noise  to  each  set  of  spectral  coefficients  is  measured 
conservatively  as  to  having  at  least  that  amount  of  added  noise  and  possibly 
more. 

SNRs  are  produced  by  adding  to  individual  Xi  sets  a  normally 
distributed  random  variable  (zero  mean,  unit  variance)  multiplied  by  the  power  in 
each  Xi,  multiplied  again  by  a  specific  dB  scale  factor  corresponding  to  the  SNR 
level  desired.  For  example,  an  SNR  level  of  -3  dB  is  achieved  by  multiplying  a 
normally  distributed  random  variable  by  the  square  root  of  the  signal  power  and  a 
scale  factor  of  the  square  root  of  two.  The  desired  noisy  signal  is  obtained  by 
using  the  equation  : 

signal  +  noise  =  signal  +  (random,  number  ♦  scale_  factor  •  .^signal_  power )  .  (1) 
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The  scaling  factors  used  in  equation  (1)  are  shown  in  Table  3.1  [5].  The 
signal  flow  diagram  is  represented  in  Figiue  3.1 1  [5]  [6]. 


TABLE  3.1:  LOG  /  SCALE  FACTOR  CHART 


Unit  Variance  Noise 


Figure  3.11:  Signal  Flow  Diagram 

Note  that  each  transient  within  every  set  has  noise  added  to  it 
specifically  based  on  its  signal  power.  The  signal  power  for  each  transient  within 


19 


a  raw  data  set  is  determined  by  squaring  each  group  oi  1020  data  points, 
summing  the  values  then  dividing  by  1020  to  determine  die  iwgninMfe 
For  a  given  transient,  the  power  is  computed  by  : 


,  1019 


Figures  12  and  13  show  the  effects  additive  nmse  has  on  transient  set 
EXCA200.  Examples  of  SNR  values  of  0  dB  through  -S  dB,  -10  dB  and  -IS  dB  of 
EXCA200  set  are  presented.  Note,  as  the  SNR  decreases  below  0  dB,  the 
determination  of  the  original  transient  set  becomes  visually  impossible. 
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Figure  3.12:  SNR  Values  of  0  dB  Through  -3  dB  for  EXCA200 


20 


TIME  TIME 


TIME  TIME 


Figure  3.13:  SNR  Values  of  -4  dB  Through  >15  dB  for  EXCA200 


Figure  3.14:  XI  with  SNRs  of  0  dB  Through  >3  dB 
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Figiire3.15:  XI with SNRsof-4, -5, -10,-15 dB 


B.  SPECTRAL-BASED  STUDY 
1 .  Noise-Free  Analysis 

The  three  spectral  templates  Xlt,  X2t  and  X3t  created  in  Part  A  of  this 
chapter  are  correlated  against  their  constituent  members  using  all  four  spectral 
measure  algcaithms.  The  results  are  presented  in  Figures  3.16  through  3.22.  The 
template  and  test  file  used  ftn*  each  correlation  are  designated  in  the  bottom  left- 
hand  portion  of  each  figure.  The  file  on  the  left  represents  the  template  and  the 
file  on  the  right  represents  the  test  file.  For  example,  in  Figure  3.16  the  template 
file  used  was  Xl_no_noise  (or  Xlt)  and  the  test  file  used  was  Xl_no_noise  (or 
XI). 

Only  the  first  64  magnitude  squared  Fourier  coefficients  are  used  in  this 
investigation  as  these  spectral  coefficients  contain  most  of  the  infoimaticM).  There 
are  four  designations  for  the  spectral  measures  used  in  each  figure.  The  first 
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designation  is  "cross-correlation  1  -  ur  ",  which  re[»esents  the  results  obtained 
using  the  normalized  cross-correlation  spectral-based  measure.  The  second 
designation  is  "cross-correlati(xi  2  -  rr  ",  which  represents  the  results  using  the 
pre-processed  data  sequence  formed  from  using  the  spectral  coefficients.  Note, 
the  mean  of  the  sequence  first  fmmed  by  the  spectral  coefficients  is  removed 
before  the  normalized  cross-correlation  values  are  computed.  The  third  and  fourth 
spectral  measure  techniques  used  are  the  Bhattacharyya  distance  and  the 
divergence.  They  are  represented  in  the  bottom  left-hand  and  right-hand  portions 
of  each  figure,  respectively. 

Figures  3.16  and  3.17  represent  the  first  set  of  correlation  results.  As 
expected,  the  spectral  measures  for  files  Xlf  and  X2t,  when  correlated  with  XI 
and  X 2  respectively,  have  high  values  (i.e.  0.9  to  1.0).  The  Bhattacharyya 
distance,  with  a  maximum  distance  value  of  1,  was  also  high  for  the  same  test  files. 
The  divergence  plots  with  possible  values  ranging  from  0.0  to  a  maximum  of  20 
(in  some  cases),  show  results  in  the  range  of  0.05  to  0.3  with  a  mean  of 
approximately  0. 1 2. 

The  X3t  compared  with  X3  had  somewhat  different  results.  Recall  from 
Part  A  in  this  chapter  that  X3  was  primarily  composed  of  spectral  coefficients  that 
did  not  fit  into  either  XI  or  X2  sets.  In  essence,  X3  is  filled  with  "all  the  rest". 
Figure  3.19  shows  the  first  three  spectral  measures  range  from  0.2  to  0.98,  the 
divergence  ranges  from  0.1  to  5.0.  Note,  because  X3t  and  X3  do  not  correlate 
consistently  with  each  other,  X3t  can  not  be  applied  as  a  usable  template. 
However,  for  purposes  of  completeness  and  comparison,  this  study  includes  X3t 
and  X3  in  all  results. 

The  remaining  figures  in  this  section  represent  comparisons  of  each 
template  with  a  different  set.  Figures  3.19  and  3.20  represent  the  results  obtained 
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by  ccMTclating  Xlt  with  X2  and  Xlt  with  X3  respectively.  As  expected,  results 
show  a  decrease  in  spectral  measure  values  from  results  obtained  in  Figures  3.16 
and  3.17.  The  cross-correlation  (both  rr  and  ur  )  and  Bhattacharyya  distance 
measures  are  much  smaller  and  the  divergence  measures  are  much  larger.  Figures 
3.21  and  3.22  refxesent  a  similar  trend  in  the  results  for  the  correlation  of  X2t 
with  XI  and  X2t  with  X3  respectively.  Poor  c(»Telation  results  are  anticipated 
because  the  frequency  informadcm  contained  in  each  file  should  not  conelate. 


Figure  3.16:  Spectral  Measure  Results  for  Xlt  Versus  XI 
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Figure  3.17:  Spectral  Measure  Results  for  X2t  Versus  X2 


Figure  3.18:  Spectral  Measure  Results  for  X3t  Versus  X3 
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Figure  3.19:  Spectral  Measure  Results  for  Xlt  Versus  X2 


Figure  3.20:  Spectral  Measure  Results  for  Xlt  Versus  X3 
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Figure  3.22:  Spectral  Measure  Results  for  X2t  Versus  X3 

The  above  comparisons  reveal  that  information  regarding  the  degree  of 
similarity  between  transients  can  be  obtained  from  all  four  spectral  measures. 
Both  cross-correlation- 1-ur  and  cross-corFelation-2-rr  each  have  straightforward 
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alg<xithms  and  are  easy  to  ctunpute  and  interpret.  The  values  range  between  [0,1] 
and  [-1,1]  respectively.  Special  attention  is  placed  on  cross-corTelation-2-iT 
technique.  The  values  obtained  via  this  measure  are  typically  the  same  as  the 
cross-correlation- 1-ur  for  files  constructed  of  the  same  sets  of  spectral  coefficients 
and  typically  lower  for  flies  constructed  of  different  sets  of  spectral  coeffleients. 
Throughout  this  study,  all  four  spectral  measures  will  be  used.  However,  cross- 
c<Htelation-2-rr  appears  to  be  the  more  robust  technique. 

2,  Signal  Plus  Noise  Analysis 
a.  Single  Run 

As  mentioned  in  Part  A.2  of  this  chapter,  the  main  thrust  of  this 
study  is  to  measure  the  performance  of  all  four  spectral  measure  algorithms  on  a 
known  set  of  signals  with  varying  amount  of  added  white  Gaussian  noise.  In  this 
section,  SNRs  from  0  dB  to  -5  dB,  -10  dB,  -15  dB  and  -20  dB  are  obtained  for 
individual  transients  within  each  raw  set.  The  resultant  "noisy  signal"  is  processed 
in  the  same  fashion  as  before  to  obtain  spectral  coeffleient  groups. 

Summary  plots  are  presented  in  Figure  3.23  through  Figure  3.34. 
Each  plot  represents  the  average  spectral  measure  for  sets  with  SNR  values  of  0 
dB  to  -5  dB,  -10  dB,  -15  dB  and  -20  dB.  The  horizontal  lines  represent  the 
average  value  of  the  original  spectral  measure.  The  reference  flies  for  each  plot  are 
labeled  Xi-Xy#db.  This  indicates  that  the  ith  template  is  used  against  the  jih  data 
file  and  is  indexed  by  the  SNR  which  can  be  read  off  the  horizontal  axes.  The 
upper  left-hand  portion  of  each  figure  shows  spectral  measure  results  for  varying 
SNRs  of  three  individual  comparisons.  The  remaining  three  graphs  in  each  flgure 
show  individual  plots  for  comparison.  A  vertical  line  is  drawn  between  the 
minimum  and  maximum  values  obtained  for  each  SNR  during  the  averaging 
calculations,  and  is  superimposed  over  the  respective  SNR  value. 
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For  example.  Figure  3.23  displays  the  average  results  using  the 
cross  correlation  spectral  measure  technique  for  Xlt  correlated  with  Xl_y  (i.e. 
Xl_Xl#db,  represented  by  the  solid  line),  X2t  correlated  with  \2_j  (i.e. 
X2_X2#db,  represented  by  the  dashed  line)  and  X3t  correlated  with  XiJ  (i.e. 
X3_X3#db,  represented  by  the  dotted  line).  The  upper  left-hand  comer  of  the 
first  graph  shows  which  Hies  are  used  in  the  correlation.  The  remaining  three 
graphs  labeled  XI  band,  X2  band  and  X3  band,  representing  the  Xlt,  X2t  and  X3t 
respectively,  show  individual  average  correlation  with  the  addition  of  minimum 
and  maximum  value  lines.  Results  show  that  spectral  measure  values  tend  to 
decrease  rapidly  at  around  -S  dB  for  the  Xlt,  X2t  correlations  and  around  -3  dB 
for  the  X3t  correlation.  One  should  pay  close  attention  to  the  minimum  and 
maximum  values  in  the  remaining  three  plots  in  each  figure  as  they  indicate  the 
amount  of  swing  to  the  average  curve  at  each  SNR  point.  In  particular,  the  Xlt, 
and  X2t  spectral  measure  curves  located  in  the  upper  right-hand  comer  and  lower 
left-hand  comer  of  Figure  3.23  respectively,  show  small  differences  between  the 
minimum  and  maximum  values  from  SNRs  of  0  dB  to  -5  dB  indicating  that  the 
average  plot  in  the  first  graph  between  SNRs  of  0  dB  and-5  dB  is  very  close  to  a 
tme  spectral  measure  plot  and  thus  very  accurate.  Whereas  for  X3t,  comparisons 
in  the  last  plot  (lower  right-hand  comer)  of  Figure  3.23,  show  wide  variations  for 
the  same  SNR  values,  indicating  that  the  tme  spectral  measure  for  that  SNR  range 
is  not  accurately  delineated  in  the  average  plot  representation.  Recall  that  X3  is 
composed  of  "all-the-rest"  transients  from  the  raw  data  sets,  thus  giving  poor 
results. 

See  Appendix  A  for  each  Xit  correlation  with  each  Xi_j  set.  These 
lead  to  the  summary  plots  presented  in  Figures  3.23  through  3.34. 
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Figure  3  J3:  Cross-Correlation  Measure  Results  for  Xlt»  X2t  and  X3t  as 
Compared  to  XI J,  X2Jy  and  XHJ  Respectively*  Averaged 

for  1  Run 
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Figure  3.24:  Cross-Corrdation  (mean  removed)  Measure  Results  for 
Xlt*  X2t  and  X3t  as  Compared  to  Xl^*  X2J,  and  X3_^’ 
Respectively*  Averaged  for  1  Run 
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Figure  3.25:  Bhattacharyya  Measure  Results  for  Xlt*  X2t  and  X3t  as 
Compared  to  X2 J,  and  X3J  Resp^vely  Averaged 

for  1  Run 
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Figure  3.26:  Divergence  Measure  Results  for  Xlf*  X2t  and  X3t  as 

Compared  to  Xl^,  X2^,  and  X3J  Respectively,  Averaged 

fnr  1  Run 
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Figure  3.27:  Cross-Correlation  Measure  Results  for  Xlt  as  Compared 
XI  j\  XI and  X3J  Respectively,  Averaged  for  1  Run 
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Figure  3.28:  Cross-Corrdation  (mean  removed)  Measure  Results  for 
Xlt  Compared  to  XI X2J,  and  X3J  Respectivdy, 
Averaged  for  1  Run 
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Figure  ?.29:  Bhattacharyya  Measure  Results  for  Xlt  as  Comiiared  to 
XI  Jt  X2Jf  and  y3J  Respectively,  Averaged  for  1  Run 
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Figure  3  JO:  Divergence  Measure  Results  for  Xlt  as  Compared  to  Xl^, 

X2J,  and  X3J  Respectively  Avm^ed  for  1  Run 
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Figure  3J1:  Cross-OMrdation  Measure  Results  for  X2t  as  Compared  to 

XI Jt  and  XiJ  Respecdvdy  Averaged  for  1  Run 
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Figure  3.32:  Cross-Correlation  (mean  removed)  Measure  Results  fear 
X2t  as  Compared  to  XI J,  XIJ,  aiid  X3J  Respectivdy 
Averag^  for  1  Run 
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Figure  3.33:  Bhattacharyya  Measure  Results  for  X2t  as  Compared  to 

'XIJ,  and  X3J  Respectively  Averaged  for  1  Run 


Figure  3.34:  Divergence  Measure  Results  for  Xlt>  X2t  and  X3t  as 

Compared  to  Xl_y,  X2 J,  and  X3J  Respectively  Averaged 

for  1  Run 
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The  summary  graphs  in  Figures  3.23  through  3.34  provide  a  way  of 
viewing  degradation  of  each  spectral  measure  technique  under  different  noise 
conditions.  Results  show  in  Figures  3.23  and  3.24  that  as  SNR  decreases  from  0 
dB  to  -S  dB  both  cross-correlation  measures  retain  their  signal  recognititm 
integrity.  An  approximate  correlation  coefficient  value  of  0.8  was  obtained  fw 
Xlt  compared  with  Xl_5  and  X2t  compared  with  X2_S  (Figure  3.23).  The 
n(»Tnalized  cross-correlati(xi  technique  with  the  mean  renmved  displays  a  slightly 
better  performance  at  values  of  -15  dB  and  -20  dB  SNR.  Overall,  this  spectral 
measure  exhibits  the  most  robust  results. 

The  Bhattacharyya  distance  and  divergence  do  not  have  the  degree  of 
performance  as  the  cross-correlation  techniques.  Both  spectral  measure 
techniques  have  poor  performance  and  are  difficult  to  use.  For  example.  Figures 
3.25  and  3.26  demonstrate  the  difficulty  in  interpreting  results  by  showing  a  0  dB 
value  for  the  Bhattacharyya  distance  at  approximately  0.82  decreasing  to  0.67  at 
-5  dB,  whereas  the  divergence  starts  at  approximately  2.5  at  0  dB  and  increases 
to  5  at  -5  dB. 

Both  cross-correlation  techniques  retain  their  integrity  when  comparing 
templates  with  other  noisy  signals  of  different  composition.  In  order  for  a 
correlation  technique  to  be  valid,  signals  of  one  composition  should  show  low 
correlation  values  when  compared  to  a  set  of  signals  with  different  compositions. 
Indeed,  the  results  in  Figures  3.27  through  3.30  show  that  when  Xlt  is  coiiq)ared 
with  X2^'  and  X3J,  cross-correlation  values  range  from  approximately  0.39  at  0 
dB  in  Figure  3.27  down  to  0.18  at  -20  dB  in  Figure  3.28.  Bhattacharyya  distance 
measures  are  comparatively  small  whereas  the  divergence  values  are  high.  Similar 
results  are  obtained  for  X2t  as  compared  to  XI J  and  X3 _J,  in  Figures  3.31 
through  3.34. 
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b.  Multiple  Runs 

In  <Hxier  to  obtain  statistically  m(xc  reliable  results,  multiple  ccxisecutive 
simulations  are  completed.  Each  time  the  MATLAB®  random  number  generaUM*  is 
accessed,  a  different  value  is  obtained.  The  random  numbers  are  used  in  the  noise 
generation  algorithm  to  obtain  many  different  SNR  realizations.  Thus  a  large 
number  of  possible  outputs  are  generated  allowing  the  computation  of  the 
desired  statistics.  This  is  accomplished  by  automating  all  of  the  algorithms  to  loop 
and  store  all  successive  run  values.  After  a  speciHed  number  of  simulations  is 
completed,  all  stored  values  are  averaged  and  displayed  in  Figures  3.35-3.46. 

Results  after  100  runs  tend  to  smooth  out  any  jagged  edges  of  the 
curves  produced  in  the  single  run  case.  The  normalized  cross-correlation 
coefficient  (mean  removed)  remains  the  most  robust  member  of  the  four  spectral 
measures. 

Figures  3.35  through  3.46  display  the  summary  results  for  100 
consecutive  runs.  Note  that  all  values  displayed  are  averaged  values.  The  vertical 
lines  represent  minimum  and  maximum  values.  These  lines  are  now  averages  of 
the  minimum  and  maximum  values  calculated  for  each  spectral  measure  within 
each  iteration. 
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Figure  3.35:  Cross-Correlatkm  Results  for  Xlt*  X2t  and  X3t  versus 

\lji  and  X^J  Respectivdy  (Averaged  for  100 
Runs). 
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F^ure  3.36:  Cross-Correlation  (nwan  removed)  M^ure  Results  for 
Xlt»  X2t  and  X3t  versus  Xl^,  X2_y,  mid  XiJ  Respectively 
(Averaged  for  100  Runs). 
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Figure  3.37:  Bhattacharyya  Results  f<H*  Xlt»  X2t  and  X3t  versus  Xl^, 
X2 Jf  and  X3  J  Respectivdy  (Averaged  for  100  Runs). 
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Figure  3.38:  Divergence  Results  for  Xlt*  X2t  and  X3t  versus  Xl^,  X2^\ 

and  X3 J  Respectively  (Averaged  for  100  Runs). 
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Figure  339:  Cross>Corrdation  Results  for  Xlt  versus  XI  Jy  X2  J,  and 

X3J  Respectively  (Averaged  for  100  Runs). 
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Figure  3.40:  Cross-Correlation  (mean  removed)  Results  for  Xlt  versus 
Xl^,  Xljy  and  X3 J  Respectively  (Averaged  for  100 

Runs). 
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Figure  3.41:  Bhattacharyya  Results  for  Xlf  versus  X2  Jf  and  X3  J 

Respectively  (Averaged  for  100  Runs). 
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Figure  3.42:  Divergence  Results  for  Xlf  versus  XI  J,  X2  J,  and  X3  J 

Respectively  (Averaged  for  100  Runs). 


41 


CfOMCon. 


Figure  3.43:  Cross-Correlation  Results  for  X2t  versus  and 

X3 J  Respectively  (Averaged  for  100  Runs). 
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Figure  3.44:  Cross-Correlation  (mean  removed)  Results  for  X2t  versus 
XI  Jf\l J,  and  X3J  Respectively  (Averaged  for  100 

Runs). 
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Figure  3.45:  Bhattacharyya  Results  for  X2t  versus  and  X3J 

Respectively  (Averaged  for  100  Runs). 
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Figure  3.46:  Divergence  Results  for  Xlt^  X2t  and  X3t  versus  XI J,  X2 

and  X3J  Respectively  (Averaged  for  100  Runs). 
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IV.  NEURAL  NETWORK  STUDY 


The  purpose  of  this  section  is  to  investigate  the  potential  af^lications  d  NN 
techniques  to  the  automatic  classification  of  the  different  transient  types  under 
study.  NNs  are  particularly  useful  in  circumstances  where  knowledge  of  a  system 
or  signal  under  test  is  not  complete  [1].  A  NN  can  be  "trained”  when  given  a 
specific  set  of  inputs  with  known  outputs.  The  system  will  then  "learn”  to 
recognize  all  input  training  values  and  give  a  speciHed  output  indicating  the 
degree  to  which  it  has  learned.  One  potential  disadvantage  of  the  NN  is  the 
amount  of  time  taken  to  adequately  train  a  new  system.  In  some  complicated 
cases  training  could  take  hours  depending  upon  processor  architecture  and  clock 
speed.  In  this  study,  training  was  done  operating  on  an  Intel  486  processor  with  a 
clock  speed  of  66  MHz  using  13  sets  of  spectral  measure  coefficients  over  50,000 
cycles,  lasting  a  total  of  45  minutes. 

The  spectral  coefficients  compute  in  Chapter  III  are  used  to  train  the  NN  to 
distinguish  between  \IJ,  XI J  and  X'iJ.  The  back-propagation  software 
package  NeuralWorks  Professional  II  /  Plus  ™  from  NeuralWare,  Inc.  is  used  for 
this  implementation.  One  hidden  layer  with  ten  processing  elements  (PE),  delta 
rule  and  sigmoid  transfer  function  with  a  learning  momentum  of  0.4  are  used  in 
the  network  configuration.  The  number  of  inputs  are  limited  to  the  first  30 
spectral  coefHcients.  Figures  3.6,  3.7  and  3.8  show  that  most  of  the  energy  is 
concentrated  in  the  first  30  coefHcients,  hence  little  information  is  lost  with  this 
restriction. 
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A.  NEURAL  NETWORK  IMPLEMENTATION 
1.  Single  Run 

Training  of  the  netwoilc  is  con^>leted  using  the  first  eight  transients 
within  XI  and  all  five  transients  within  X2.  Because  of  its  divo^  transient 
composition,  no  transients  from  X3  are  used  for  testing  at  this  time.  Tables  4.1a 
and  4.1b  represent  actual  training  set  data  [Mesented  to  the  netwoik.  Two  training 
set  types  are  used  to  determine  which  (H-oduce  the  best  results.  The  first  training 
method  uses  linear  spectral  coefficients.  The  second  training  method  reduces  the 
size  of  each  spectral  coefficient  by  taking  10*logio  of  each  coefficient.  This 
provides  the  NN  a  set  of  numbers  that  have  a  smaller  dynamic  range.  Smaller 
coefficients  allow  the  NN  to  classify  each  training  set  with  more  accuracy. 

Results  show  that  the  second  method  of  U’aining  the  NN  produces  the 
best  results.  The  first  group  of  eight  sets  of  numbers  in  Tables  4.1a  and  4.1b  are 
the  first  30  spectral  coefficients  expressed  in  dB  from  each  of  the  first  eight 
transients  within  the  Xlt.  The  second  set  of  numbers  in  Table  4.1b  represent  the 
first  30  spectral  coefficients  expressed  in  dB  from  all  five  transients  in  the  X2t.  In 
total,  13  transients  are  used  to  train  the  NN. 
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NEURAL  NETWORK  TRAINING  FILE 
(XI  pubes  1>6) 

-0.10339730  0.03634666  0.04437024  0.04312217  0.03891442  0.03814090 
&  0.03696092  0.03236073  0.04016163  0.04203824  01)4281337  0.04330580 
ft  0.04276869  0.04072964  0.04112996  0.04162601  01)4071784  0.03953620 
ft  0.03837882  0.03684341  0.Q36199Q2  0X)3733729  0.03630070  0.03410361 
ft  0.03438815  0.03237043  0.03261731  0.03416606  0.03121338  0.03201160 
ft  1  0 

-0.10412377  0.03330432  0.04474068  0.04312217  0.03907324  0.03827783 
ft  0.03712461  0.03293426  0.04022175  0.04198339  0.04282273  0.04346007 
ft  0.04273191  0.04063471  0.04114667  0.04139701  0.04061973  0.03960966 
ft  0.03838484  0.03676783  0.03618738  0.03743853  0.03626942  0.03373113 
ft  0.03440080  0.03293662  0.03301495  0.03374968  0.03151317  0.03228719 
ft  1  0 

-0.10238326  0.03361032  0.04382800  0.04312217  0.03883667  0.03806950 
ft  0.03706032  0.03134492  0.04067270  0.04226781  0.04287938  0.04363774 
ft  0.04266048  0.04086227  0.04122862  0.04139732  0.04093171  0.03949742 
ft  0.03846224  0.03720602  0.03634637  0.03713581  0.03636644  0.03465282 
ft  0.03435278  0.03187390  0.03242711  0.03448124  0.03125790  0.03120387 
ft  1  0 

-0.10946020  0.03800291  0.04323401  0.04512217  0.04041234  0.03625963 
ft  0.03688324  0.03301763  0.03923185  0.04105163  0.04269334  0.04343358 
ft  0.04300986  0.04123532  0.04060320  0.04142916  0.04046444  0.04026002 
ft  0.03818432  0.03682291  0.03724765  0.03733290  0.03601997  0.03451368 
ft  0.03533661  0.03499694  0.03339726  0.03316743  0.03478948  0.03259249 
ft  1  0 

-0.10096127  0.03773260  0.04376575  0.04512217  0.04026209  0.03566665 
ft  0.03687833  0.03194318  0.03832100  0.04069720  0.04248331  0.04321347 
ft  0.04264282  0.04096236  0.04040007  0.04120822  0.04033493  0.04010331 
ft  0.03792932  0.03681304  0.03730630  0.03770689  0.03614185  0.03445579 
ft  0.03460283  0.03467387  0.03311363  0.03210032  0.03420875  0.03163605 
ft  1  0 

-0.09864677  0.03775632  0.04361893  0.04512217  0.03998230  0.03619930 
ft  0.03638698  0.03272732  0.03896292  0.04068223  0.04228334  0.04297313 
ft  0.04260976  0.04094436  0.04029393  0.04117116  0.04022218  0.03998305 
ft  0.03764655  0.03640016  0.03708801  0.03699700  0.03590523  0.03389567 
ft  0.03527287  0.03421544  0.03295929  0.03281600  0.03411650  0.03127680 
ft  1  0 

TABLE  4.1A:  NEURAL  NETWORK  TRAINING  USING 

10*LOGio  RULE 
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NEURAL  NETWORK  TRAINING  FILE 
(XI  pubes  7>8,  X2  pubes  1-5) 

-0.10379639  0.03806691  0.04413436  0.04512217  0.04000709  0.03647318 
A  0.03696489  0.03343683  0.0384S018  0.04084762  0.04240947  0.04324443 
&  0.04274341  0.04100363  0.04063063  0.04133947  0.04052914  0.04021049 
&  0.03822340  0.03681338  0.03679876  0.03699968  0.03580268  0.03461304 
A  0.03450352  0.03442964  0.03333210  0.03269047  0.03410249  0.03131648 
A  1  0 

-0.09621912  0.03479013  0.04334402  0.04512217  0.03948681  0.03874464 
A  0.03526762  0.03686932  0.03834803  0.04110362  0.04134914  0.04267878 
A  0.04212548  0.03997838  0.04045517  0.04035744  0.03996985  0.03949738 
A  0.03734601  0.03658093  0.03726464  0.03489060  0.03590131  0.03500549 
A  0.03357158  0.03355487  0.03414739  0.03348790  0.03244893  0.03339234 
A  1  0 

-0.10472980  0.03569208  0.03490455  0.02944288  0.03592090  0.03765672 
A  0.04257619  0.04398213  0.04063548  0.04188770  0.04291037  0.03833229 
A  0.04468902  0.04583590  0.04631609  0.04619198  0.04408585  0.04066791 
A  0.04135226  0.03925247  0.02610017  0.03534030  0.03471306  0.03318219 
A  0.03507054  0.03352930  0.03359315  0.03591629  0.03298004  0.03177198 
A  0  1 

-0.11423284  0.03697584  0.03321140  0.02944288  0.03090771  0.03986090 
A  0.04333232  0.04419206  0.04239541  0.04130497  0.04328245  0.04203018 
A  0.04478324  0.04747504  0.04822262  0.04746034  0.04493113  0.04008196 
A  0.04176842  0.04211552  0.03972958  0.03098337  0.03527343  0.03472697 
A  0.02718298  0.03291009  0.03417993  0.03373240  0.03003015  0.03072631 
A  0  1 

-0.10647562  0.03411767  0.02921005  0.02944288  0.03827274  0.03834013 
A  0.04237091  0.04465111  0.04149322  0.04188736  0.04339307  0.03932660 
A  0.04518953  0.04597174  0.04656535  0.04666887  0.04453281  0.04099870 
A  0.04136220  0.03829430  0.03629588  0.03677536  0.03079313  0.03439039 
A  0.03334536  0.032295%  0.03388935  0.0329%20  0.02678400  0.03044681 
A  0  1 

-0.10501991  0.03589363  0.03236945  0.02944288  0.03245705  0.03922029 
A  0.04213724  0.04267701  0.04110792  0.04016834  0.04162046  0.04069242 
A  0.04350005  0.04597550  0.04666584  0.04588801  0.04334099  0.03827481 
A  0.04043083  0.04070264  0.03893869  0.03399264  0.03244048  0.03420498 
A  0.03159380  0.03174811  0.03417691  0.03464519  0.03344666  0.03199372 
A  0  1 

-0.10180893  0.03706216  0.03608059  0.02944288  0.03372297  0.04123339 
A  0.04368668  0.04421203  0.04319250  0.04105323  0.04108768  0.04191953 
A  0.04331473  0.04468200  0.04499360  0.04404569  0.04142466  0.03772487 
A  0.03886177  0.03855310  0.03577731  0.03014992  0.03337440  0.03435041 
A  0.03432923  0.03367878  0.03062972  0.031070%  0.03250538  0.03222779 
A  0  1 

TABLE  4.1B:  NEURAL  NETWORK  TRAINING  USING 

10*LOGio  rule 
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After  training  is  completed,  testing  sets  ai^  produced  with  SNR  levels 
from  0  dB  to  -20  dB  using  white  Gaussian  noise  outlined  in  Chapter  3. 
Appendix  B  presents  the  NN  results  for  all  Xi^  tested  against  the  trained 
networic.  There  are  16  possible  sets  fear  Xl^*  and  5  sets  fOT  X2J.  Each  table  in 
Appendix  B  jnesents  separate  NN  outputs  for  each  Xlt  or  X2t  with  SNR  values 
of  0  to  -5  dB  (in  one  dB  steps).  -10  dB,  -IS  dB  and  -20  dB.  The  notatiem  XiJ  is 
used  to  represent  the  template  Xi  with  -j  dB  SNR.  For  example  Xl_2dB  means 
that  each  transient  within  the  XI  template  has  an  SNR  of  -2  dB.  The  XI  and  X2 
columns  under  the  NN  Ideal  Ou^ut  have  either  ones  ot  zeros.  A  number  one  in 
the  XI  column  and  a  zero  in  the  X2  column  under  the  NN  Ideal  Output  means 
that  the  set  of  values  being  tested  are  related  to  XI  and  not  X2.  The  XI  and  X2 
under  the  NN  Tested  OuQ)ut  represent  the  actual  values  obtained  after  testing. 
Numbers  closest  to  1  indicate  strong  correlation  between  the  trained  NN  and  the 
tested  values,  whereas  numbers  closest  to  zero  indicate  weak  correlation  between 
the  trained  NN  and  the  tested  values. 

A  summary  of  results  for  the  noisy  signals  produced  from  a  single  run  is 
presented  in  Table  4.2.  Top  and  bottom  sections  represent  testing  using  either  Xlt 
or  X2t  respectively.  The  first  column  in  each  section  designates  which  test  set  is 
used.  The  second  and  fourth  columns  display  average  output  values  with  a 
maximum  possible  value  displayed  on  top  of  the  column.  For  example,  a  value  of 
0.9887873  is  obtained  in  the  XI  table  under  the  ”1"  section  in  column  two  for 
Xl_(-3  dB).  This  result  demonstrates  the  NN  has  calculated  a  0.9887873  out  of  a 
possible  1.0  value,  indicating  that  the  signal  tested  is  more  than  likely  a  member  of 
the  Xlt  class.  The  third  and  Hfth  colunms  display  the  standard  deviation  of 
numbers  in  obtaining  each  average  value.  These  numbers  are  very  useful  in 
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determining  how  close  each  average  value  is  in  relation  to  the  overall  average. 
Standard  deviation  values  are  a  big  determination  factw  in  choosing  to  use  each 
coefficient  expressed  in  dB  during  the  training  process.  Recall  that  the  sigmoid 
transfer  function  is  used  in  the  NN  configuration.  By  deflnition,  the  results  should 
then  be  in  the  interval  [0,1]  however,  the  NeuralWorks  Professional  II/Plus 
software  internally  rescales  the  output  values  when  using  the  MiniMax  table 
option.  For  this  reason  some  output  values  may  be  slightly  larger  than  1  or 
slightly  less  than  zero. 


XI 


1 

Ava. 

Std.  D4V. 

0 

Avg. 

Std.  Dev. 

KWlTm 

KWBEUI 

1.0030456 

0.0254554 

•0.0000231 

0.0232048 

0.9923662 

0.0238875 

0.0109496 

0.0240785 

KUifrPl^l 

MllViUcI 

KiHffCUll 

1  0.9837167 

0.0585917  1 

0.0194570 

0.0573308 

mesLQji 

0.9757227 

■illiFFITFFl 

0.0281420 

0.0317096 

Enramji 

TOFfFFflM 

0.0452866 

0.0487668 

QHBmm 

1  0.7987847 

0.1200738 

0.2080957 

0.1236332 

1  0.8242014 

0.1231212 

0.1804250 

0.1222050 

X2 


Tatted  Seta 

0 

Avg. 

Std.  Dev. 

1 

Avg. 

Std.  Dev. 

1  X2_(0dB)  1 

1  0.2303900 

0.1245466 

0.7722318 

0.1229367 

KilFfURTl 

0.0718728 

0.7719382 

0.0672361 

EXTFFFZFl 

R»llI:l:rHiZl 

■SREEI31 

1  0.2896448 

0.1613317 

0.7211064 

0.1562198  1 

1  0.3098798  1  0.1032637  I  0.6901816  1  0.1072366  1 

Kfas-fuii 

0.6156368 

0.1799645 

0.3885900 

0.1677991 

EEmsmm 

0.6786284 

0.1034576 

0.3235496 

0.0966601 

1 

1 

TABLE  4.2:  AVERAGE  VALUES  FROM  SINGLE  NN 

TESTING  RUN 
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Results  for  the  single  run  are  very  good.  The  XI  pcMtion  of  Table  4.2 
demcMistrates  correlation  values  of  0.97  (nr  greater  down  to  -5  dB  bNR  and  a 
strong  performance  of  0.82  down  to  -20  dB  with  a  very  low  standard  deviation. 
The  X2  pcMtion  of  Figure  4.2  displays  results  that  are  not  quite  as  good.  A  0.72 
value  was  obtained  at  -3  dB.  This  may  be  due  to  the  increased  diversity  amongst 
transients  in  the  X2  set. 

2.  Multiple  Runs 

Once  results  are  obtained  for  a  single  run  case,  multiple  runs  are 
completed.  The  intent  of  multiple  runs  is  to  test  the  integrity  of  the  trained  NN  by 
obtaining  many  sets  of  ouq>uts  and  to  have  statistically  mme  reliable  results.  The 
MATLAB®  software  package  is  used  once  again  to  generate  all  SNR  data  files. 

Table  4.3  represents  the  average  values  calculated  for  100  runs.  The  results 
are  organized  in  the  same  fashion  as  in  Figure  4.2. 
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XI 


1  0 


X2 


Tasted  Sets 

0 

Avg. 

Std.  Dev. 

1 

Avg. 

std.  Dev. 

X2  (OdB) 

0.2251065 

0.1118897 

0.7790914 

0.1108506 

X2_(-1dhl 

0.2339048 

0.1115452 

0.7700723 

0.1116177 

X2  (•2dBl 

■•KNclcI.fiJ  ■•Xi'jcl-ki-lcl 

KSfEsnn 

0.2960157 

0.1390701 

0.7087087 

0.1386071 

1  X2_(-4db)  1 

0.3342565 

0.1446113 

0.6701 185 

0.1442856 

■•KUIMIcl 

Eytaiigmi 

0.5174339 

0.1599166 

0.4871487 

0.1612239 

QjxoEEnn 

0.6482288 

0.1568769 

0.3581118 

0.1574939 

gRFTffiil 

■•KFUITIIll 

TABLE  4.3: 


AVERAGE  VALUES  FROM 
NN  TESTING  RUNS 


00  CONSECUTIVE 


Results  show  that  the  average  correlation  values  under  the  "1"  section 
of  the  XI  portion  of  Tables  4.2  and  4.3  are  greater  than  the  values  in  the  "1" 
section  of  the  X2  portion.  These  values  are  a  function  of  the  types  of  transients 
within  the  data  sets  used.  High  correlation  values  in  the  XI  part  of  Tables  4.2  and 
4.3  are  due  to  the  small  amount  of  diversity  among  transients  composing  the  XI 
set.  Whereas  the  lower  correlation  results  in  the  X2  portion  of  Tables  4.2  and  4.3 
are  attributed  to  the  increased  diversity  between  transients  composing  X2. 
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V.  SOFTWARE  IMPLEMENTATION 


Two  types  of  software  packages  are  used  in  this  study,  MATLAB®  [4]  from 
Math  Works  Inc.,  and  NeuralWorks  Profe^ional  n/Plus^  hr<Mn  NeuralWaie,  Inc. 

A.  NEURALWORKS  PROFESSIONAL II/PLUS™ 

All  neural  netwoik  (NN)  programming  presented  in  Chapter  IV  is  perfonned 
using  NeuralWoiks  Professional  II/Plus^  fr(»n  NeuralWare,  Inc..  System  training 
and  testing  is  done  as  stated  in  Chapter  4.  "Snapshots”  of  the  network 
architecture  in  untrained,  training  and  trained  mocte  are  presented  in  Figures  B.39, 

B. 40,  B.41  and  B.42  in  Appendix  B. 

B.  MATLAB®  SOFTWARE  IMPLEMENTATION 

All  spectral  measure  studies  presented  in  Chapters  II  and  III  are  completed  by 
using  the  MATLAB®  program  package  to  take  advantage  of  the  software 
graphing  capabilities  [4].  The  training  and  test  files  for  the  NN  are  also  produced 
using  MATLAB®. 

Several  programs  and  functions  are  written  to  handle  single  and  multiple  run 
spectral  measures.  There  are  two  main  program  sets.  Each  program  set  operates  on 
sponsor  supplied  raw  data  sets  the  same  way.  The  major  difference  between  the 
single  and  multiple  run  algorithms  are  the  linking  of  all  programs  in  order  to  repeat 
runs.  All  programs  in  the  multiple  run  case  are  linked  sequentially,  producing 
output  values  which  are  stored  in  matrix  form  for  averaging  and  plotting. 

Both  sets  of  programs  utilize  two  basic  functions,  LOFAR.M  and  DIST.M. 
Either  program  may  be  used  with  or  without  degraded  signal  sets.  A  larger 
program  entitled  "BIG.M"  was  written  to  incorporate  LOFAR.M,  DIST.M,  noise 
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generation  functions,  summing  functions,  averaging  functions  and  plotting 
routines  into  one  large  recursive  algorithm  in  order  to  accomplish  multiple  runs. 
All  MATLAB®  code  used  in  this  work  is  presented  in  Appendix  C. 

1.  Program  D1ST.M  [1] 

The  program  DIST.M  was  modifled  from  [1].  This  {M’ogram  computes  all 
frequency- based  measures  presented  in  Chapters  II  and  III.  In  addition,  this 
program  also  computes  the  various  frequency-based  measure  averages  and 
standard  deviations  for  each  of  the  files  tested.  The  reference  file  is  designed  to  be 
the  reference  template  (i.e.  Xlt,  X2t  or  X3t),  whereas  the  test  files  could  be  any  set 
of  spectral  coefficients  of  interest. 

2.  Program  LOFAR.M  [1] 

The  program  LOFAR.M  was  modified  from  [1].  This  program  computes  the 
spectral  coefficients  used  for  the  frequency-based  measure  and  NN  studies. 

Several  options  exist  in  this  program  for  raw  data  calculation.  The  fu^t  option 
is  to  truncate  decimate/interpolate  the  data  to  compensate  for  the  change  in 
sampling  rates.  The  remaining  options  are:  mean  removal,  power  spectrum  and 
rectangular  or  Hamming  window.  The  number  of  non-zero  data  points  in  the 
transform  is  1020,  the  step  size  in  data  points  is  1020  and  the  transform  length  is 
1024. 
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VI.  SUMMARY  AND  RECOMMENDATIONS 


A.  SUMMARY 

This  study  examines  spectral-based  techniques  to  efHciently  and  reliably 
detect  and  categorize  certain  classes  of  transient  signals  embedded  in  additive 
white  Gaussian  noise.  Two  approaches  have  been  considered. 

The  flrst  approach  considers  the  use  of  four  spectral  measures  to  distinguish 
between  classes  of  transients.  These  measures  include  the  normalized  cross¬ 
correlation  coefficient,  the  modified  normalized  cross-correlation  coefficient,  the 
Bhattacharyya  distance  and  the  divergence  (related  to  the  Kullback-Liebler 
number).  Results  show  that  these  measures  adequately  classify  the  transients  into 
three  different  classes.  They  also  indicate  that  the  modified  normalized  cross- 
correlation  coefficient  tends  to  have  more  robust  classification  features.  Next,  the 
robustness  of  the  spectral-based  measure  to  classify  the  transients  is  investigated 
by  degrading  the  test  data  with  additive  white  Gaussian  noise.  The  SNRs  used 
are  between  0  dB  and  -20  dB.  Results  show  that  the  modified  normalized  spectral 
cross-correlation  coefficient  (i.e.  mean  removed)  exhibits  the  best  performance. 

The  second  approach  uses  a  back-propagation  NN  approach.  The  NN  was 
initially  trained  to  distinguish  between  two  different  classes;  Xlt  and  X2t.  The 
third  class  X3t  is  considered  a  compilation  of  different  transient  types,  and  is  not 
used  for  training.  Experimental  results  show  that  the  NN  can  be  successfully 
trained  to  distinguish  between  two  classes  under  high  and  low  SNR  conditions. 

The  two  problems  with  the  NN  implementation  are  a  lengthy  training  time 
and  classification  of  transients  not  belonging  to  the  sets  being  trained  on. 
Training  is  time  consuming  and  is  difficult  to  do  accurately  for  small  class  sizes. 


The  spectral-based  measure  is  based  on  inner  products  and  is  computationally 
faster.  In  addition,  the  NN  classifies  X3t  as  belonging  to  Xlt  or  X2t.  Reducing  the 
number  of  training  iterations  does  not  substantially  improve  the  NN  performance 
for  this  condition.  The  spectral  measure  techniques  tend  to  classify  unknown 
transients  more  reliably. 

There  are  two  drawbacks  to  both  the  spectral-based  measure  implementation 
and  NN  implementation.  The  first  is  the  manual  selection  needed  to  deHne  each 
reference  template.  This  process  is  tedious  and  time  consuming.  However,  once 
completed,  the  classification  is  fast  for  both  the  spectral  measure  techniques  and 
the  NN  approach.  The  second  drawback  is  the  definition  of  the  threshold  used  to 
decide  whether  or  not  a  test  transient  belongs  or  does  not  belong  to  a  specific 
class.  Results  show  that  the  modified  cross-correlation  coefficient  seems  to  be 
approximately  0.95  with  no  added  noise  and  0.4  at  -10  dB  SNR.  Additional 
experiments  with  a  larger  number  of  transients  per  class  are  needed  to  accurately 
determine  an  appropriate  threshold  for  detection. 

B.  RECOMMENDATIONS 

There  are  three  recommendations: 

1. )  The  vector  size  is  fixed  at  taking  the  first  64  or  30  spectral  coefficients  for 
the  correlation- based  and  NN-based  implementation,  respectively  in  experiments. 
It  is  noted  that  a  smaller  number  of  spectral  coefficients  could  be  utilized  for  some 
of  the  transients  studied.  Reducing  the  number  of  power  coefficients  in  the 
classification  scheme  will  reduce  the  computational  load.  Thus  one  should 
examine  the  issues  of  potential  speedup  versus  classification. 

2. )  Empirically  the  threshold  used  to  decide  whether  or  not  a  particular  signal 
belongs  to  a  given  class  seems  to  be  a  number  around  0.95  for  high  SNR 
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(essentially  no  added  noise)  for  individual  frequency-based  measures.  In  CM'der  to 
obtain  more  accurate  results  at  low  SNRs,  additional  experiments  with  a  lai^ger 
numbers  of  transients  per  class  are  needed  to  accurately  determine  an  approfniate 
threshold  for  classification  in  order  to  simulate  real  world  results. 

3.)  The  NN  was  trained  using  Xlf  and  X2t.  The  set  X3t  was  not  used  for 
training  because  of  its  odd  transient  composition.  When  X3t  was  tested  as  an 
unknown  transient  group  against  the  trained  NN,  results  indicate  that  the  NN  is 
unable  to  determine  that  X3t  doesn't  belong  either  to  XI t  or  X2t.  Thus  issues 
dealing  with  the  relationships  between  small  training  set  sizes,  and  unknown 
transients  need  to  be  investigated  to  help  solve  this  problem. 
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APPENDIX  A.  INDIVIDUAL  SPECTRAL  MEASURES 

The  following  figures  represent  60  individual  spectral  measure  plots  for  each 
template  as  compared  to  other  templates  with  varying  SNRs.  The  lower  left-hand 
portion  of  the  graph  displays  the  names  of  the  two  files  tested.  The  flrst  file  is  the 
reference  template  and  the  second  file  is  the  reference  template  with  added  noise. 
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A.15:  Xlt  correlated  against  X2_(-3dB) 
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A.16:  Xlt  corrdated  against  X2_(-4dB) 


A.17:  Xlt  corrdated  against  X2_(-5dB) 


A.20:  Xlt  corrdated  against  X2_(-20dB) 
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A.33:  X2t  correlated  against  X2_(-ldB) 
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A.44:  X2t  correlated  against  X3_(-2dB) 
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A.45:  X2t  correlated  against  X3_(-3dB) 


8 


I 


A.49:  X2t  correlated  against  X3_(-15dB) 
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A^3:  X3t  corrdated  against  X3_(-ldB) 
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nr.  th:  X3.MjMin  •  M  Am:  X3_4A 


A.56:  X3t  correlated  against  X3_(-4dB) 


A.57:  X3t  correlated  against  X3_(-5dB) 


A.60:  X3t  correlated  against  X3_(-20dB) 
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APPENDIX  B 


NEURAL  NETWORK  RESULTS 


The  following  sections  show  individual  and  composite  results  for  the  neural 
network  when  trained  and  tested  using  10*logio  (dB)  of  each  spectral 
coefficient.  The  last  section  presents  a  "snapshot"  of  the  NeuralWorks 
Professional  II  /  Plus  network  during  the  Hrst  200  training  cycles  and  after  it  has 
completed  all  50,000  training  cycles. 


A.  NEURAL  NETWORK  RESULTS  USING  dB  SPECTRAL 
COEFFICIENTS 
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B.2:  X1_(-1DB)  TEST  RUN  USING  DB  COEFFICIENTS 
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B.5:  X1_(-4DB)  TEST  RUN  USING  DB  COEFFICIENTS 


91 


X1_5dB 


HIHHHIH 1 1  i.  M  4 

NNt 

XI 

X2 

XI 

X2 

1 

0 

0.90314 

0.013854 

1 

0 

0.984001 

0.026575 

1 

0 

0.057086 

0.041634 

1 

0 

0.080571 

0.027812 

1 

0 

0.002165 

0.107397 

1 

0 

1.005079 

0.002241 

1 

0 

vjTzrpm  ■nrzfirrfl 

1 

0 

■RiTTZYTli 

1 

0 

■iniFZTa 

1 

0 

Kxmiui 

1 

0 

0.093003 

0.010887 

1 

0 

0.042066 

0.05006 

1 

0 

0.055701 

0.04488 

1 

0 

1.020501 

-0.024103 

1 

0 

0.976064 

0.026104 

1 

0 

0.098067 

0.010717 

Avg.  V.IU. 


88cx55>:^£i3 


B.6:  X1_(.5DB)  TEST  RUN  USING  DB  COEFFICIENTS 
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B.8:  Xl_(.  J  5DB)  TEST  RUN  USING  DB  COEFnCIENTS 


X1_20dB 


NNJdaal_outgiit_^^_^^_^__2INJ|Mtad_ou^irt 


XI 

X2 

XI 

_ X2 _ 1 

1 

0 

0.870019 

1 

0 

0,711968 

0.29582 

1 

0 

0.767978 

0.253558 

1 

0 

0.913239 

0.084851 

1 

0 

0.471338 

0.515487 

1 

0 

0.841823 

0.149467 

1 

0 

0.685123 

0.326985 

1 

0 

0.902874 

0.093297 

1 

0 

0.887823 

0.115002 

1 

0 

0.745001 

0.263297 

1 

0 

0.934202 

0.059282 

1 

0 

0.909674 

0.092459 

1 

0 

0.918507 

0.093795 

1 

0 

0.924973 

0.078777 

1 

0 

0.873648 

0.140561 

1 

0 

0.173374 

B.9: 


S£^:^X3P8]83«8:'3$0^3Ci 


Avg.  Valua  :[ _ 

Std.  Dav.  : 
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B.n:  X2_(.1DB)  TEST  RUN  USING  DB  COEFFICIENTS 
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B.  NEUIULNETWOMC  RESULTS  USING  SPECTRAL  COEFTICIENTS 
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1.026007 

-0.021023 

1 

0 

1.015069 

■BilTTPfZV 

1 

0 

1 

0 

1.040122 

1 

0 

1.00320 

-0.0113261 

1 

0 

1 

0  . 

1 

0 

niniFTza  BTirnTTTi 

1 

0  . 

nnFTTni 

0 

1 

0 

1.044034 

-0.017687 

1 

0 

0.060745 

0.029360 

1 

0 

1.037074 

-0.01035 

1 

0 

1.030801 

-0.016360 

1 

0 

1.016384 

-0.000301 

B.23:  X1_(-3DB)  TEST  RUN 


X1_4dB 


XI 

X2 

XI 

X2 

1 

0 

0.00691 

0.014118 

1 

0 

1.020904 

•0.01223 

1 

0 

1.044623 

-0.023806 

1 

0 

1.020535 

-0.022416 

1 

0 

1.009080 

0.004466 

1 

0  1  1.043172  1  -0.015444  1 

1 

0 

1 

0 

ElFFmTl 

1 

0 

nrmm 

K«XIM14 

1 

0 

M'l'MUJ 

1 

0 

0.967084 

0.043551 

1 

0 

0.932738 

0.035637 

1 

0 

1.010362 

•0.045238 

1 

0 

1.003631 

0.001089 

1 

0 

1.043786 

-0.016485 

1 

0 

1.044384 

Avg.  ValiM 
Std.  D.V. 

B.24;  X1J-4DB)  TEST  RUN 
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XI.SdB 


Avg.  VakM 


Std.  Oav. 


B.25:  X1_(-SDB)  TEST  RUN 


XI.IOdB 


NN  li 

XI 

X2 

1  XI  1  X2 

1 

0 

1  1.007762  1  0.016115 

1 

0 

1  1.04475  *0.017211 

1 

0 

1 

0 

1  1.044041  -0.017361 

1 

0 

1  1.019833  0.004041 

1 

0 

1  0.975041  0.094982 

1 

0 

■  ■nrrTTFPfl  ■nnfxm 

1 

0 

■  nrmm  Kinrm 

1 

0 

■  EirxiTm 

1 

0 

1 

0 

1.042963  *0.015612 

1 

0 

0.741976  0.304724 

1 

0 

1.021775  0.001911 

1 

0 

0.809704  0.176132 

1 

0 

1.030621  *0.025276 

1 

0 

1.042517  *0.018122 

Avg.  Valua  J  'ItM 
Std.  Dav.  • 


B.26:  X1_(-10DB)  TEST  RUN 
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XI.ISdB 


XI 

X2 

1 _ XJ _ 

_ xx _ 1 

1 

0 

BIFXVZFFI 

1 

0 

1.043215 

-0.016486 

1 

0 

0.B7086S 

0.123394 

1 

0 

1  1.033399  1  -0.028427  1 

1 

0 

0.844725 

0.154753 

1 

0 

1.044736 

-0.017204 

1 

0 

1  0.981499  1  0.038596  1 

1 

0  1  0.72067 

0.334055  1 

1 

0 

1.022012 

1 

0 

1.044073 

-0.01643 

1 

0 

1.044671 

-0.017187 

1 

0 

1.032771 

-0.029025 

1 

0 

0.687611 

0.246589 

1 

0 

1.029817 

0.007382 

1 

0 

1.037477 

-0.013628 

■irTTTTTH  Eirmri^ 

Avg.  V.IIM 
Std.  D«v. 

B.27:  X1_(-15DB)  TEST  RUN 


X1_20dB 


NN  Id— I  output _ WW  ttfd  output 


XI 

X2 

i _ XJ _ 

_ X2 _ 1 

1 

0 

1 

0 

0.820394 

1 

0 

0.702694 

0.27107 

1 

0 

1.042916 

-0.01418 

1 

0 

1.041825 

-0.014615 

1 

0 

1 

0 

0.618574 

0.241181 

1 

0 

0.765128 

0.207375 

1 

0 

1.044734 

-0.017203 

1 

0 

1.037327 

-0.004915 

1 

0 

0.706115 

0.178429 

1 

0 

1.044248 

-0.017002 

1 

0 

1.044749 

-0.017211 

1 

0 

0.824666 

0.173036 

1 

0 

0.585622 

0.39251 

1 

0 

Avg.  Value 


std.  Dav.  :l  0.180t2l1 


B.28:  X1_(-20DB)  TEST  RUN 
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X2_0dB 


XI 


X2  I 


Std.  0«v.  :  ^ 


B^9:  XIJODB)  TEST  RUN 


X2_1dB 

NW  ld<al  output _ NN  t— ttl  output 


XI 

X2 

XI 

_ X2 _ 1 

0 

1 

0.922756 

0 

1 

0.223926 

0.71707 

0 

1 

0.961132 

0.018058 

0 

1 

0.709805 

0.337286 

0 

1 

0.838353  1  0.147331  1 

Avg.  VaiiM 


ium\ 

mmmm 

it:  M>wnTig'ii 

B.30:  X2_(-1DB)  TEST  RUN 


X2_2dB 


NN  h 

XI 

X2 

1  XI  1  X2  1 

0 

1 

0 

1 

0 

1 

0 

1 

0 

1 

1  0.755016  1  0.259407  1 

Avg.  Valua 


std.  oav.  :  mmmmm 


mm: 


B3l  :  X2_(.2DB)  TEST  RUN 
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X2_3dB 


XI 

X2  1  XI  X2 

0 

1  1  1.0241  -0.00410 

0 

1 

0 

1 

0 

1^—  ■.»»  Vil-li  M 

0 

Avg.  ValiM 


Std.  D«v. 


B32:  X2_(.3DB)  TEST  RUN 


X2_4dB 


XI 

X2 

— xTH 

X2 

0 

1 

rnwYimm 

-0.003201 

0 

1 

!  0.240717 

0 

1 

0.403305 

0 

1 

0.00S888 

0.022001 

0 

1 

0.652073 

0.270706 

Avg.  ValiM 
Std.  Oav.  : 

BJ3:  X2_MDB)  TEST  RUN 


X2_5dB 


XI 

X2 

XI 

X2 

0 

1 

0.738745 

0.211714 

0 

1 

1.002306 

0.003658 

0 

1 

0.221736 

0 

1 

1  1.035853 

-0.014408 

0 

1 

■niirn^Bi 

Avg.  Valua  :l  FI 

Std.  D  w.  :  I  S.ldiidli  S.1S2S7SI 


B.34;  X2_(-5DB)  TEST  RUN 
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Avg.  ValiM  : 

Std.  D«v.  : 

B3S  :  X2_(-10DB)  TEST  RUN 


X2_15dB 


1.044748 

-0.01721 

0.721217 

0.33342 

0.930551 

0.082492 

HTirmi 

nprnzn 


Finmii 


Avg.  Value 
Std.  Dav.  : 

B36:  X2_(-15DB)  TEST  RUN 


NN  Maal 


X2_20dB 


NN  taatad 


0.721196 


1.044528 


1.043985 


1.041209 


0.743722 


0.333437 


-0.017184 


•0.018838 


-0.018027 


0.223446 


Avg.  Value 
Std.  Dav.  : 

B37:  X2_(-20DB)  TEST  RUN 
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XI 


1  0 

TMtod  S9t»  Avg. _ Std.  D»v. _ Ava. _ Std.  D»v. 


FxT 

_(0dB) 

1.01748019 

0.02417026 

-0.0045534 

0.03505935 

■31 

(-1dB) 

1.02886888 

0.01225069 

•0.0232079 

0.00928075 

■31 

(-2dB) 

0.99781694 

0.00691475 

0.0581243 

(>3db) 

1.017275 

0.02130865 

-0.0051389 

0.02107345 

■3Km01 

1.00194969 

0.07020321 

0.00533744 

0.0549967 

oi 

_(-5dB) 

0.98380206 

0.09183735 

0.02732269 

0.08736725 

EH 

(-lOdB) 

0.99104638 

0.09213024 

0.03231738 

0.09130805 

EH 

(-15dB) 

0.96752094 

0.04399688 

0.1116471 

EH 

(•20dB) 

0.87166544 

0.16751046 

l.miWcME! 

0.13092134 

X2 


0  1 


1  X2  rOdBI  1 

0.5517028 

0.1224759 

0.412785 

0.11582168 

■lasEiJi 

0.7351944 

0.30345772 

0.2562774 

0.28521129 

0.6819714 

0.11977469 

0.2904358 

0.08371245 

waaoEESM 

0.7248556 

0.40470856 

0.2831218 

0.39350862 

msmsESM 

0.6862572 

0.3289881 

0.299548 

0.30439704 

■HRmoi 

0.915294 

0.14230777 

0.0830222 

0.12227511 

iHoiimoi 

0.9360404 

0.10047734 

0.0712954 

0.08284199 

Eoramm 

0.9319822 

0.13231954 

0.0983486 

0.14349261 

0.918928 

0.17041299 

0.1009668 

B  J8:  AVERAGE  FOR  ALL  RUNS  USING  SPECTRAL 

COEFnCIENTS 
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C  "SNAPSHOT”  OF  NEURAL  NETWORK 


Naural  Natwofk 

TriinlnQ  Situp 


y 

1 

1 

1 

1 

1 

ItotMorh 


H  i  d  d  e  n  1 

.kv. 


B.39:  Neural  Network  Training  Setup 


The  tools  used  in  the  NN  analysis  are  displayed  in  Figures  B.39  through 
B.42.  The  small  squares  and  circles  at  the  bottom  and  in  between  each  NN 
configuration  represent  initial  weights  to  be  applied  to  each  of  the  30  input 
values.  As  the  training  process  continues  these  weighs  or  processing  elements, 
(PE)  will  grow  and  shrink  into  different  sizes.  The  larger  the  circle,  the  larger  the 
weight  for  that  PE. 

The  Confusion  Matrix  tool  gives  a  visual  indication  of  how  well  the  netwoik 
is  doing.  Ideally  what  one  would  like  to  have  the  bins  (cells  in  each  matrix)  on  the 
diagonal  from  the  lower  left  to  the  upper  right  showing  the  highest  counts.  This 
indicates  the  network  is  giving  an  output  that  matches  the  desired  output  [8] 
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The  histogram  at  the  top  of  the  Classification  Rate  tool  refnesents  the  desired 
results.  The  histogram  of  the  rows  represents  the  actual  netwoiic  predictions.  The 
body  of  the  Classification  Rate  tool  presents  the  intersection  of  the  desired  results 
and  actual  netwcn-k  predictions  [8]. 

The  Network  Weights  tool  shows  the  weight  distributions  as  they  are 
updated  in  the  training  process.  Initially,  the  weights  will  start  out  close  to  zero. 
As  the  network  is  trained,  some  weights  will  move  away  from  their  near  zero 
starting  points.  [8] 

The  RMS  error  tool  measures  the  root  mean  square  error  for  all  processing 
elements  in  the  output  layer  as  the  NN  is  being  trained.  [8] 


B.40:  Neural  Network  Training  in  Process 
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B.41:  Trained  Neural  Network  using  dB  Coefficients 
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APPENDIX  C.  MATLAB®  CODE  IMPLEMENTATION 


The  following  programs  were  written  for  the  spectral  measure  techniques 
discussed  in  Chapters  U  and  III  of  the  text  and  for  the  training  and  testing  sets 
used  with  the  NN  in  Chapter  IV. 


A.  SINGLE  RUN  PROGRAMS 


Cl:  Program  no.noise  LOFAR.M  [1] 


%  This  program  computes  the  LOFARGRAM  based  on  windowed  periodograms  and  display 
%(modifled  from  the  original  program  completed  by  Dr.  Ralph  Hippenstiel  and  Dr. 
%Monique  P.  Fargues) 
clear  pow 

count=inputCHow  many  no.noise  input  files  would  you  like  to  enter  »  '); 
for  loopct  s  Ixount 

fname=:iiq)ut('entire  name  of  input  file  is  (w/o  ext) » ‘,'s'); 

evalCiload fiiame,'.dat']); 

name=eval(fname); 

eval(['clear  '.fnamej); 

iopt=input('mean  removed:  y/n=l/0  »  '); 

int=input('data  truncation  for  exc210*220-230:  y/n=l/0  »  ’); 

isq=input('get  power  spectrum  (1)  or  abs  value  (0)»  '); 

iwin=input('use  hamming  window  (1)  or  not  (0)»  '); 

[drow,dcolumn]=size(name) ; 
if  (frow-=l 

name=name.'; 

end 

len=length(name) ; 

id=input('  No.  of  non-zero  data  points  in  transform  '); 
step=iiq)ut('  shift  (step  size)  in  data  points  '); 
tlen=iiq)ut('transform  length  '); 
i=fix((len-id)/step)+ 1 ; 

if  int==l  %  data  truncation  for  exc2 10-220-230 
id2=408; 
end 

if  iwin— l,win=hamming(id).'; 
elseif  iwin~0,  win=ones(l,id);  end 
for  ic=l:i 

clear  temp  tempO  temp2 
%  interpolate  data  for  exca210 
if  int==l 
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teii4)0(l:ld2)«iiaine(l-Kic-l)*step:id2-Kic-l)*step); 
tem^«lnlerp(tein|)0^); 
teiiq>Bdediiiate(teiiip2,2.30,'fir  r); 
dse 

temp(  1  :id)sname(  1  -f  (ic- 1  )*stq):idKic- 1  }*step); 
end 

if  ioptssl  %  for  data  mean  removed 
iempBtemp-mean(temp): 
end 

%  direct  oomput  for  data  mean  kept 
%I^wsabs(ffk(name(l‘Kic-l)*step:i(h-(ic-l)*step).*win,tlen)); 
ppowsabs(fft(tdnp.*win.tlen));  %  for  sipt(power  qwctrum)  eval. 
if  isqssl,  ppows^w.^2;  end  %  for  power  specmim  eval. 
pow(ic.:)sp(K>w(  1  :tlen/2); 
end 

powc=fliptid(pow); 

clear  name  drow  dcolumn  len  id  stq)  tlen  i  ic  win  ppow 
%**************************«******•**********«**•*«********** 
%  THIS  PORTION  OF  THE  PROGRAM  ASSIGNS  UNIQUE  VARIABLE  NAME 
%  TO  EACH  INPUT 

^**************«*****************«***********************,*** 

if  ftiame=*EXCA200* 
pow_20(H)Ow; 
powc_200^wc; 

elseif  ftiame»'EXCA210' 
pow_210=pow; 
powc_2IO^wc; 

elseif  fname=^'EXCA220* 
pow_220=pow; 
powc_220^wc; 

elseif  fname='EXCA230' 
pow_230=pow; 
powc_230=powc; 
end 
end 

X  l_no_noise=X  l_fcn(pow_200,pow_2 10,pow_220,pow_230); 
X2_no_noise=X2_fcn(pow_220); 

X3_no_noise=X3_fcn(^w_210,pow_220,pow_230); 
fjprintfCprint  contours  using  powc  -plot  using  pow  transpose  \n') 


C2:  Proffam  iioisy_LOFAR.M  [1] 

%  Hiis  program  computes  the  LOF^GRAM  ba^  on  windowed  p^odograms  and  displays 
%the  results  in  a  waterfall  type  fashion 

%(modified  from  the  original  program  completed  by  Dr.  Ralph  Hippenstiel  and  Dr. 
%Monique  P.  Fargues) 

clear  pow 

%»  =  ”  shift,  option,  \" 

0,****^,*t*************0*** ************** 
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%  THIS  PORTION  OF  THE  PROGRAM  CORUFTS 
%  ALL  THE  SIGANLS  WITH  NOISE 
^  **«****•***•*****«•********•*****••**** 
countBloputCHow  many  noisyjnput  flies  would  you  like  to  enter  »  '); 
fw  looprount«l:count; 

fnamesinputC  number  of  each  noisy  signal  is  »  ','s‘); 
nnamesiqMitC  what  negative  decibel  do  you  want »  Vs'); 
scaleseval(nname); 
eval([’load  EXCA'.fname,'.dat']); 

RAWDATAseval(['EXCA'.fname]): 

%  the  s  means  input  willbe  string  variable 

evaI(['noisy_sig_',nname,'dbJ.ftiame.'=noisy_sig(RAWDATA^ale);']); 

namesseval(['noisy_sig_',nname.'db_',fliame]); 

eval(['clear  ',fnanie]); 

%  now  we  clear  orig.  data 
name=eval(['noisy_slg_'.iuiame.'db_'.fnaroe]); 
iopt=input('mean  removed:  y/n^lA)  »  '); 
intsinputC'data  truncation  fw  exc2 10-220-230:  y/n^lA)  »  '); 
isqsirqwtCget  power  spectrum  (1)  or  abs  value  (0)»  y, 
iwin=inputCuse  hamming  window  (1)  or  not  (0)w  *); 
[drow,dcolumn]=size(  name) ; 
if  drow-=l 

name=name. , 
end 

len=length(name); 

idsit^NitC  No.  of  non-zero  data  points  in  transform  '); 
step=input('  shift  (step  size)  in  data  points  *); 
tlensin^tCtransform  length  '); 
i=flx((len-id)/step>f  1 ; 

if  int=l  %  data  truncation  for  exc2 10-220-230 
id2=408; 
end 

if  iwins=l,win=hamming(id).': 
elseif  iwin=0,  winsones(l,id);  end 
for  ic=l;i 

clear  temp  tempo  temp2 
%  interpolate  (tota  for  exca210 
if  int=l 

temp(X  1  :id2)=name(  1  +(ic- 1  )*step:id2+(ic- 1  )*step); 
temp2=inter{KtempO,S); 
tempsdecimate(temp2,2,30,'flr  1 '); 
else 

temp(  1  :id)=name(  1 +(ic- 1  )*step:id+(ic- 1  )*step); 
end 

if  iopt=l  %  for  data  mean  removed 
temp=temp-mean(temp); 
end 

%  direct  comput.  for  data  mean  kept 
%ppow=abs(fft(name(  1  +(ic- 1  )*step:id+(ic- 1  )*step).*win,tlen)); 
l^w=abs(flt(temp.*win,tlen));  %  for  sqrt(power  spectrum)  eval. 
if  isq=l,  ppow=^w.''2;  end  %  for  power  spectrum  eval. 
pow(ic,:)=ppow(  1  :tlen/2); 
end 

powc=flipud(pow); 
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clear  name  drew  dccriunm  ten  id  step  tien  i  ic  win  ppow 
eval(['EXCA'4name,*_'.nname.'db_powspow;']); 
eval(['EXCAMnaroe.'_'.muune,'db4)owc^x>wc;']); 
end 

eval(['XlJ,nnanie,'dbsXl_fcn(EXCA200_',nnaitte,'db_pow^CA210_'.nname.'db_pow.EXC 

A220J,nnanie,'db_powJEXCA230j4Uiame.'(te4)ow);']); 

eval(['}bj,nnanie,'db«X2_fcn(EXCA220_‘.nname.‘db_i^w);’)); 

eval(['X3J,nnanie,'(fl>sX3_fcn(EXCA210_'.nname,*db_pow^CA220_'.nname,'db_pow^C 

A230J.nnanie/db_pow);’]); 

^ntf(t)rint  contours  using  powc  -plot  udng  pow  transpose  \n') 


CJ:  Program  DIST.M  [1] 

clear  uryrrbrtrmrxief  refit  refd  xqts  yeps 


%  THIS  IS  THE  UPDATED.  AUTOMATED  "DIST  FUNCTION. 
^**********««**********************************************«* 

%(modifled  from  the  original  i^ogram  completed  by  Dr.  Ralph  Hippenstiel  and  Dr. 
%Monique  P.  Fargues) 

%  this  function  computes  the  different  distances 
%  rr  is  the  normalized  cross  correlation  (no  DC  component  present) 

%  ur  is  the  normalized  cross  correlation  (includes  potential  DC  effects) 

%  tr  is  the  Divergence  (Kullman-Leibner) 

%  br  is  the  Bhatti^aryya  distance  (coefficient  implemented) 

%  mr  is  the  Matsushita  distance 
%  xfite  is  the  input  «ray  1st  idex  Is  pulse  Number 
%  2nd  idex  is  freq.  (i.e.  bin  number) 

%  function  (ur4T.br.tr,mr]  =  dist(r^erence,xfite) 

%  ref  is  the  tempiated  (reference  signal) 

%  function  [ur4T,br,tr4nr]adist(ref,x) 

^00*#*t*»0000**00*0*0***»»0000000m0*************00*********** 

RUNSsiiqwtCHow  many  times  do  you  wldch  to  run  this  program  ??  »  ’); 
for  Run=l:RUNS 

clear  uryrrbrtrmrxref  refii  refd  xeps  yeps 
fite.refsinputCinput  ref.file  XI  .X2  or  X3  »  ','s'); 
refS=eval((flte_ref,'_i»_noise'l); 

refO=log(refO);  %  THIS  TAKES  THE  LOG  ...  GET  RID  OF 

fite_tes^nput('input  test  files  »  ','s'); 

xseval([file_test]); 

x*log(x);  %  THIS  TAKES  THE  LOG  ...  GET  RID  OF 
%i|dotsinput('pIot  y/n=l/0:  '); 
iplotsl; 
if  ipIots=l 

%iwin=input('data  used  rect  wind.  (0)  or  hamming  wind.  (1); '); 
iwin=0; 

test_fil®fite_test; 

isq=0; 

end 

if  isqssi  %  square  input  data  for  run  in  bad3  and  good3  (no  square 
ref0=ref0.^2;  %  factor  present  in  lofar.m  up  to  2/9/93 

x=x.^2; 
end 
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%  con^Mite  reference  tenqriate 
ref«iiiean(refO): 

(n,b]ssize(x); 

refn«ref-mean(reO; 

ref(t>Te&simi(reO;  %suin  over  each  col.  to  get  norm.  ref. 
refnsrefn4eps*ones(refn);refdsrefd4^s*ones(refd); 
for  isl:n 

xeps(i.;)=x(i,:H^*ones(x(i.:)); 

ur(i)aref*x(l,:)'/(sqrt(ref*ref*xeps(l,:)*xeps(i,:)’)); 

y(i.:)sx(i.:)-m^x(i.:)); 

yei)s(i,:)=y(i,:)+ep8*oiies(y(i,:)); 

rr(l>^fti*y(i,:)7(sqrt(refn*refn’*yq[)s(l,:)*yeps(i.:)')): 

x(i.:>Bxe{^i.:Vsuin(xeps(i,:));  %  normalization  over  row  for  pdf 
br(i^sum(sqrt(refd.*x(i.:))); 

tr(l)=sum((log(iefd7x(i.:)).*refdHlog(rcfd7x(i.:)).*x(i.:))); 
miti>^rt(  sum((  sqrt(x(l,:))  •  s^(refd)  ).^2) ); 

%p«use 

end 

%ref_f=num2str(flle_ref) ; 
test_fsnum2str(test_fll); 

vssCref.  file:  ',flle_fef,'_no_noise  -  test  files:  ',test_fl; 
fjprintf(v).^ntf('\n') 

%  compute  averages 

RR=mean(rr);UR=mean(ur):BRsmean(br);TR=mean(tr);MR=mean(mr); 

eval(I’ur_',file_ref,’_',flle_test,’=ur;'l); 

eval(['URJ,flle_ief.*_'4ile_test.’=UR;']); 

eval(('min_URJ,flle_ref.’_’,flle_test.'=niin(ur);*]); 

eval(('max_UR_',file_ref,'_'.file_test,'=max(ur);*]); 

eval(['rrJ,file_ief,'J,file_test,’ssrr;']); 

eval(t'RRJ.flle_tef;j.file.test,*=RR;’l); 

eval(('min_RRJ,file_ref,'J,file_test,'=min(rr);*]); 

eval((’max_RR_',fite_ref,'_',flle_test,'=max(rr);’l); 

eval(['brj.file_ref,’_',file_test,'=br;']); 

eval(('BR_’,flle_ref,'J.file_test,'=BR;’]); 

eval(('min_BRJ,flle_ref,'_',flle_test,’=min(br);']); 

eval(t’max_BRJ,flle_ref,'_',flle_test.'=max(br);’]); 

eval(l'trj.flle_ref;j.file_test.'=tr;']); 

eval([TR_',file_ref,’_',flle_test,'=TR;']); 

eval(['min_TR_',file_ref,'_',file_test,'»min(tr);']); 

eval([’max_TR_',file_ref,’_',file_test,'=max(tr);l); 

fprintfCRR:  %g  UR:  %g  BR:  %g  \n',RR.UR,BR) 
fi)rintf(TR:  %g  MR:  %g\n\n',TR.MR) 
RRs=std(rr);URs=std(ur);BRs=std(br);TRs=std(tr);MRs=std(mr); 

eval([’URs_*4ile_ref;_',flle_test,'=URs;’]); 

eval(['RRs_',file_ief.'_’.file_test,'=RRs;']); 

eval(['BRsJ.file_ref,'_'4ile_test,'=BRs;]); 

eval(ITRs_',file_ref,'_',flle_test,'=TRs;'j); 

fprintfCRRs:  %g  URs:  %g  BRs:  %g  \n',RRs,URs,BRs) 
fprintfCTRs:  %g  MRs:  %g\n',TRs.MRs) 
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If  ipiOtssI, 

Cig 

t-Tref.  nb’l; 

%ref.f«niim2str(flle_tef); 
test_f«Duiii2str(test_fiI); 
sub|rtot(22 1  ).plot(ur) 
xlabelCref.  nb  ) 

Ude(’cro8s-o(Mrelatk>ii  1  •  ur') 
sul^ot(222),plot(rr) 
xlaMCref-  nb') 
dtleCcross-correlatton  2  -  »*) 
subplot(223),(riot(br) 
text(.21..035.t.'sc') 
dtle^hattacharya  dlst  -  bO 
subplot(224).plot(tr) 
tcxt(.71,.035.t,'sc') 
ddeCDivergenoe  -  aO 
%text(.892,0,date2,‘sc') 
if  iwin»0, 

text(-4S..S.'iect.  window'/sc*) 

elseif  iwlfiss;l,text(.4S,  j,*hainiiiing  wiiidowVsc');end 

v={’ref.  file:  ',flle_ref,'_no_n(dsc  -  test  flies:  ',iest_fl; 

tcxt(.12,0,v,'sc') 

end 

end 

end 

clear  uryirbrtrmrxief  refn  tefd  xeps  yeps  RUNS  Runs  flle.ref; 

clear  refO  flle.test  x  iplot  iwin  lef.fll  test.fll  isq  ref  i  ur  y; 

clear  ref.f  test.f  v  b  n  UR  URs  TR  TRs  Run  RRs  RR  MRs  MR  BR  BRs  t; 


C.4:  Function  Noisy_Sig.M 
funcdon  noisy=noisy_sig(RAW_DATA,db); 
if  dbs=0  %  Scale  for  noise 

scalesl; 
elseif  dbcsi; 

scalessqrt(1.26); 
elseif  db»2; 
scale=sqrt(1.6); 
elseif  db==3; 

scale=s(|rt(2); 
elseif  db=s4; 

scale=sqrt(2.S): 
elseif  db=sS; 

scale=s(pt(3.2); 
elseif  dbs=6; 

scale=sqit(4); 
elseif  dbs=7; 

scale=sqtt(S); 
elseif  (fl>=8; 

scale=sqrt(6.3); 
elseif  db=9; 
scale=s^(8); 
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elsdf  db»10; 

scalessqrt(10); 

elseif 

scaless^(12.6); 
elseif  db^lz; 

scal<^s^(16); 
elseif  dbBsl3; 

scal6Bsqit(20); 
elseif  (tt>»=14; 

scaleBsqrt(2S); 
elseif  dbsslS; 

scaleBS^32); 
elseif  db=sl6; 

scaleBS<^(40); 
elseif  <n>ssBl7: 

scalessqrt(SO); 
elseif  dl>ssl8; 

scale=sqn(63); 
elseif  db«19; 

scal6ssqtt(80); 
elseif  dbs=20; 

scale=s({rt(100); 

end 

rand('nonnal'): 
len=length(RAW_D  ATA) ; 
segnients=fix(leii/ 1 020) ; 
for  isl;segments-t-l 

A=(((i-I)*1020>4-1); 

B=(i*1020); 

C>=len: 

if  1 

pwr(i)=(suin((RAW_DATA((A:B)))/2))/1020; 

noisy_sig(  A:B)=(RAW_DATA(  A:B))+(sqrt(pwr(i))*scale*rand( 1 , 1 020)’); 

pwr(i)=(suin(^W_DATA(A:C)).''2))/1020; 

seg=length(RAW_DATA(A:C)); 

noisy_sig(A:C)=(RAW_DATA(A:C))+(sqrt(pwr(i))*scale*rand(  1  ,seg)’); 
end 
end 

noisy=noisy_sig'; 


C5:  Function  Noby_Xl_fcn.M 


function 

ans=noisy_X  l_fcn(pow_200_noise,pow_2 10_iK>ise,pow_220_noise.pow_230_noise) 

ans=[pow_200_noise; 

pow_2 1 0_noise(  1 , : ); 

pow_2 1 0_noise(3,:); 

pow_2 1 0_noise(4, : ) ; 

pow_2 10_noise(5 ,:); 

pow_2 10_noise(6,:); 

pow_230_noise(  1 ,:); 

pow_230_noise(2,:); 
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pow_230_iK)i8e(3.:); 
pow_230_iioi8C(5,;); 
pow_230_iiolse(6.:); 
pow_230_noi8e(7,:); 
pow_230_iK)i8e(8,:); 
pow_230_iK)lsc(9,:)l ; 


C.6:  Functioa  Noisy.X2_fcii.M 

function  anssnoisy_X2_fcn(pow_220_ooise) 

anss[pow_220_noise(  1 

pow_220_noise(2,:); 

pow_220_noise(4,:); 

pow_220_noi8e(5,:); 

pow_220_noise(6,:)j; 


C.7:  FunctKHi  Noisy_X3_fciLM 

function  ans=noisy_X3_fcn(pow_2 10_nolse,pow_220_noise,pow_230_noise) 

ans=[pow_2 10_noise(2, :); 

pow_220_noise(3,:); 

pow_230_noise(4,:); 

pow_230_noise(  10,:); 

pow_230_noise(l  1,:); 

pow_230_noise(  12,:); 

pow_230_nolse(  13,;)]; 


B.  MULTIPLE  RUN  PROGRAMS 


C,8:  Program  BIG.M 

******  **************¥***0*************  ********* 
%  SYSTEM  CHECK  PROGRAM 

9^*«*4i*4i4i****4i«****«*«******«4>*4i******************<|i****4>* 

clg; 

clear, 

randnCseed',0); 

BIG_adder_clear; 
for  loopy  =  1:100; 

[Top  of  Loopy  loq)'] 
loopy 

BIG_no_noise_lofar; 

[’finished  ,BIG_no_noise_LOFAR'] 

BIG_noisy_LOFAR; 

['finidied  ,BIG_noisy_LOFAR'] 

BIG_DIST_all_var; 

BIG_band2_plots; 
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[‘Onished  BIG_baiKl_plots'] 

BIG.summer; 

('flnidied  BlG.summa^] 
inarksnuin2str(loopy); 

['did  the  mark'] 
mark 

BIG_var_save 

clear 

eval(['Ioad  n.ACE_MARK']):  %this  saves  the  |4ace  mark 
['Just  loaded  PLACE_MARK  after  the  clesr'] 
eval([1oad  GRAPH_',mark]); 
end 

BlG_average; 

['finished  BIG.average'] 

BIG_plots; 


C.9:  Program  BlG_adder_dear.M 

^«4i**4.*4i4i*4i4i**4i***4i««***?«**«*4i*******4i*****4i**«**4i***** 

%  This  ciears  the  adding  matrix 

^in^m***** ************  *********************************** 

adder_b=2eros(3, 10); 
adder_c=zeros(3, 10); 
adder_d=zeros(3, 10); 
adder_e3:zeros(  3,10); 
adder_bl=zeros(3, 10); 
adder_cl=zeros(3,10); 
adder_d  1  =zeros(3, 10); 
adder.e  1  =zeros(3 ,10); 
adder_b2=zeros(3, 10); 
adder_c2=zeros(3 , 1 0) ; 
adder_d2=zeros(3, 10); 
adder_e2=zeros(  3,10); 

adder_bb=zeros(2, 10); 
adder_cc=zeros(2, 10) ; 
adder_dd=zeros(2, 1 0) ; 
adder_ee=zeros(2, 1 0); 
adder_bb  1 =zeros(2, 1 0) ; 
adder_cc  1  =zeros(2 , 1 0) ; 
adder_ddl=zeros(2, 10); 
adder_ee  1  =zeros(2 ,10); 
adder_bb2=zeros(2, 10); 
adder_cc2=zeros(2 ,10); 
adder_dd2=zeros(2, 10); 
adder_ee2=zeros(2 ,10); 

adder_bbb=zeros(  1,10); 
adder_ccc=zeros(  1,10); 
adder_ddd=zeros(  1 , 10); 
adder_eee=zeros(  1,10); 
adder_bbb  1  =zeros(  1,10); 

8Klder_ccc  1  =zeros(  1,10); 
adder_ddd  1  =zeros(  1,10); 
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adder.eee  1  szeros(  1 . 1 0); 
adder_bbb2=za’os(  1.10); 
i^er_ccc2szeTOs(  1.10); 
adder_(kld23zeros(  1.10); 
aiddOT_eee2szeros(  1.10); 

adder_bbbbszeros(2. 10); 
adder_ccccszeros(2. 10); 
adder_(kkkl>:zeros(2. 10); 
adder_eeeeszeros(2. 10); 
adder.bbbb  1  azeros(2 .10); 
adder.cccc  1  szeros(2. 1 0); 
aclder_ddddl»zeros(2. 10); 
adder_eeeelszeros(2. 10); 
adder_bbbb2szeros(2, 10); 
adder_cccc2szeros(2. 10); 
adder_(kkld2szeros(2 .10); 
adder_eeee2=zero$(2. 10); 


C.IO:  Pn^ram  BIG_b>nd2_j»iots.M 

%  BIG_band2_4)lots; 

^  *4i**«i»«**4i******4i«  *********************  **  *<.*41 

%  THIS  PROGRAM  CALCULATES  AND  PLOTS  CURVES 
%  BASED  ON  RESULTS  FROM  THE  CORRELATIONS 

^  o******************************************** 

%  THIS  PORTION  HANDLES  THE  no.noise  SITUATIONS 
for  x=l:3 

xx=nuin2str(x); 

b(x.l)=evaI(['UR_X'.xx.'_X'.xx.'_no_iK)ise’]);  %  this  is  for  avg  # 

c(x.  1  )s=eval(['RR_X'.xx.'_X'.xx.'_no_noise']); 
d(x.  1  )=eval([TR_X'.xx.'_X'.xx.'_iK)_noise'l); 
e(x.  1  )=eval(('BR_X'.xx.'_X'.xx.'_no_iK)ise’]); 

bl(x.l)=eval(['inin_UR_X'.xx.’_X’.xx.*_no_noise’]);  %  this  is  for  rain  # 
c  1  (x.  1  )=eval(['rain_RR_X'.xx.'_X'.xx.’_no_noise’]); 
dl(x.l)=eval(['rain_TR_X',xx.’_X'.xx.'_iK)_noise’]); 
e  1  (x,  1  )=eval(['rai  n_BR_X'.xx.'_X'.xx.’_no_noise’]); 

b2(x.l)=eval([’raax_UR_X'.xx.'_X'.xx.'_no_noise']);  %  this  is  for  max  # 
c2(x.  1  )=eval(['raax_RR_X'.xx.'_X'.xx.’_no_noise']); 
d2U.  1  )=eval([’raax_TR_X'.xx.'_X'.xx.’_no_noise']); 
e2(x.  1  )=eval([’raax_BR_X’.xx.’_X'.xx.’_no_noise']); 
end 


%  THIS  PORTION  HANDLES  ALL  THE  REST 
for  x=l:3; 
for  y=I:9; 

xx=nura2str(x); 

raat=[0  1  2  3  4  5  10  15  20]; 

yy=num2str(raat(y)); 
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b(x.y+ 1  )=eval([’UR_X’^x;_X’.xx.'_‘.yy.'db*l); 
c(x,y+l)=eval(('RR_X’.xx,’_X',xx.*J.yy.'db*l); 
d(x.y+l)=eval([TR_X’.xx,’_X’.xx.‘J.yy,'db‘l); 
e(x.y+l)=eval((’BR_X*.xx.’_X’,xx.*_’.yy.*db'l); 

b  1  (x,y+ 1  )=eval(['inin_UR_X',xx,'_X',xx,'_',yy,'db’}); 
cl  (x,y+  l)=evaI(['inin_RR_X',xx.'_X’,xx.’_'.yy,’db’]); 
dlU.y+l)=eval(['iiiin_TR_X',xx,'_X'.xx.'_',yy,‘dbl); 
el(x,y+ l)=eval(t’inin_BR_X',xx,’_X’,xx,'_',yy,*db  ]); 

b2(x,y+ 1  )=eval(['iiiax_UR_X',xx,'_X',xx.'_*,yy,'db'I); 
c2(x,y+ 1  )=eval([’max_RR_X',xx.’_X',xx,’_',yy,’db']); 
d2(x,y+ 1  )=evaI(['max_TR_X',xx,'_X',xx,’_‘,yy,*db']); 
e2(x,y-f  1  )=eval(t’max_BR_X',xx,'_X',xx,’_’,yy.'db’]); 
end 
end 

^  ****************** 
%  THIS  PART  SORTS  XI  WITH  X2  &  X2  WITH  X3 
^  0**0***m************************************* 

%  THIS  PORTION  HANDLES  THE  no.noise  SITUATIONS 

for  x=l:2; 
xx=nuni2str(x-»-l); 
xy=num2str(x); 

bb(x,  1  )=eval(['UR_X'.xy,’_X',xx,'_no_noise';]); 
cc(x,l)=eval(['RR_X',xy,'_X',xx,'_no_noise';i); 
dd(x,  1  )=eval(['TR_X’,xy  .'_X'  ,xx,'_no_noise';l); 
ee(x,i;^eval(t’BR_X’,xy,'_X',xx,'_no_noise';l); 

bb  1  (x,  1  )=eval(t'min_UR_X',xy  ,’_X',xx,'_no_noise';]); 
cc  1  (x,  1  )=eval(['niin_RR_X’,xy,'_X',xx,'_no_noise';]); 
ddl(x,l)=eval(['min_TR_X',xy,'_X',xx,’_no_noise’;]); 
eel(x,l)=eval(['min_BR_X',xy,'_X',xx,'_no_noise’;]); 

bb2(x,  1  )=eval(['max_UR_X',xy,'_X',xx,'_no_noise';)); 
cc2(x,  1  )=eval(['niax_RR_X',xy  ,'_X',xx,'_no_noise’;]); 
dd2(x,  1  )=evaI(['niax_TR_X’,xy,'_X',xx,’_no_noise’;]); 
ee2(x,  I  )=eval(['max_BR_X',xy  ,'_X',xx,'_no_noise';]); 
end 


for  x=l:2 
for  y=l:9 


xx=num2str(x); 
xxx=nuni2str(x+ 1 ) ; 
mat=[0  1  2  3  4  5  10  15  20]; 
yy=num2str(mat(y)); 

bb(x,y+ 1  )=eval(['UR_X',xx,’_X',xxx,’_’,yy,'db’;)); 
cc(x,y+ 1  )=eval([’RR_X’,xx,'_X'.xxx,'_’,yy,'db’;  1); 
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<ld(x.y+l)-evaI([TR_X’,xx,LX’.xxx.'J.yy;db';l); 

ee(x.y+l)=eval(rBR_X'.xx.’_X*.xxx.*J,yy.’db’;)); 

bb  1  (x,y+ 1  >seval(['ini  n_UR_X',xx,'_X',xxx,’J,yy,’<lb’  ;1) ; 
cc  1  (x,y+ 1  >seval([’inln_RR_X’,xx,’_X’,xxx,’_',yy,’db’;i); 
ddl(x.y+l)=eval([’inin_TR_X’^x.'_X'.xxx.‘_*,yy,’db’;l); 
ee  1  (x.y+ 1  )=evaI(I'inin_BR_X',xx,'_X',xxx,’J,yy,’db';]); 

bb2(x,y+l)=eval(rnjax_UR_X’,xx,’_X*,xxx.'J,yy,'(tt)';]); 
cc2(x,y+l)=eval(['iiiax_RR_X’.xx.'_X'.xxx,*_',yy,‘db’;]); 
d^(x,y+l)=eval([’max_TR_X',xx,’_X’,xxx,'_',yy,’db';l); 
ee2(x,y+ 1  )sseval(['max_BR_X’.xx,'_X',xxx,'J,yy,’db';)); 
end 
end 

gj,  ****  **4i**«  ***********  4I*********************** 

%  THIS  PART  SORTS  XI  WITH  X3 

95,  ********************************************* 

bbb(  1 , 1  )=min_UR_X  1  _X3_no_noise; 
ccc(  1 , 1  ^min_RR_X  1  _X3_no_noise; 
ddd(  1 , 1  )=min_TR_X  1  _X3_no_noise; 
eee(  1 , 1  )=min_BR_X  1  _X3_no_noise; 

bbb  1(1,1  )=min_UR_X  1  _X3_no_noise; 
ccc  1  ( 1 . 1  )^niin_RR_X  1  _X3_no_noise; 
dddl(l,l)=min  .TR_Xl_X3_no_noise; 

'wl(l,l^mln_BR_y  ’  _X3_no_noise; 

bbb2(l,l)=ma;c_Lti  •  i_X3_no_noise; 

2(l,l)=niax_Rk_y»l_X3_no_noise; 

(knl2(  1 , 1  )=max_TR_X  1  _X3_no_noise; 
eee2(  1 , 1  )=max_BR_X  1  _X  3_no_noise; 

for  x=l; 

for  y=2;10; 

xx=:num2str(x); 

xxx=nuni2str(x+2); 

mat=[0  0  1  2  3  4  5  10  15  20]; 

yy=num2str(mat(y)); 

bbb(x,y)=evaI(['UR_X',xx,'_X',xxx,’_’,yy,'db';]); 

ccc(x,y)^eval(('RR_X',xx,'_X',xxx,'_’,yy,’db';]); 

ddd(x,y)=eval([TR_X',xx,'_X',xxx,'J,yy,’db';j); 

eee(x,y^eval(['BR_X',xx,'_X',xxx,'_*,yy,'db’;i); 

bbbl(x.y)=eval([‘niin_UR_X',xx.’_X’,xxx,*J,yy.’db’;]); 
ccc  1  (x,y)^vaI(['niin_RR_X'.xx,’_X',xxx,’_'.yy.'db';]); 
dddl(x,y)=eval(['mln_TR_X',xx,'_X',xxx,'J,yy,'db’;)); 
eeel(x,y)=eval(['inin_BR_X',xx,'_X'.xxx,'J,yy,’db';]); 

bbb2(x,y)=eval(['max_UR_X',xx,’_X',xxx,’J.yy»'<fl>’;]); 

ccc2(x,y)=eval(['niax_RR_X',xx,’_X',xxx,'_’,yy,'db’;]); 

ddd2(x,y)=eval(['niax_TR_X',xx,'_X',xxx,'J.yy.’db’;j); 

eee2(x,y)=eval(['max_BR_X',xx,'_X',xxx,’_’.yy.’db';]); 

end 
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end 


%  ****0**0****0****»**0*****0**********D******* 

%  THIS  PART  SORTS  X2  WITH  XI 

^  4i*««4i*******«*****«****«**«««4i«»«****»««****i|i 


bbbb(l  ,l)=min_UR_X2_X  l_no_nolse; 
cccc(  1 ,  l^inln_RR_X2_X  l_no_noise; 
dddd(l,  l)=inin_TR_X2_Xl_no_noise; 
eeee(  1 , 1  )=nrin_BR_X2_X  l_no_noise; 

bbbbl(l,l>=min_UR_X2_Xl_no_noise; 
ccccl(l,l)=inin_RR_X2_Xl_no_dolse; 
dddd  1(1,1  )=niin_TR_X2_X  1  _no_noise; 
eeee  1  (1 , 1  )=min_BR_X2_X  1  _no_nolse; 

bbbb2(  1 , 1  )*max_UR_X2_X  1  _no_noise; 
cccc2(  1 , 1  )=max_RR_X2_X  l_no_noise; 
dddd2(  1 , 1  )=inax_TR_X2_X  1  _no_noise; 
eeee2(  1 , 1  )=max_BR_X2_X  1  _no_noise; 

for  x=2; 

for  y=2:10; 

xx=num2str(x); 

xxx=num2str(x-l); 

mat=(0  0  1  2  3  4  5  10  15  20]; 

yy=num2str(inat(y)) ; 

bbbb(l,y)=eval([’UR_X',xx.*_X'.xxx,'J.yy,’db‘;]); 
cccc(  1  .y^val(['RR_X',xx,’_X',xxx,’_’.yy.’db';]); 
dddd(l,y)=eval(fTR_X’.xx.’_X',xxx.*_',yy.’db’;J); 
eeee(l,y>=eval([’BR_X',xx,'_X’,xxx.'J,yy,'db*;]); 

bbbb  1  ( 1  ,y)®eval(('min_UR_X',xx,'_X',xxx,'_’.yy,’db’;]); 
cccc  1  (x,y)=eval(('imn_RR_X',xx,'_X',xxx,’J.yy  ,'db';]); 
dddd  1  ( 1  ,y)=eval(['inin_TR_X',xx,'_X',xxx,'_’,yy,’db';]); 
eeee  1  ( 1  ,y)=eval(['inin_BR_X',xx,'_X',xxx.’_',yy,'db’;]); 
bbbb2(  1  ,y)=seval(['max_UR_X',xx,'_X',xxx,’_’,yy,'db*;i); 
cccc2(  1  ,y)=eval(['max_RR_X’,xx,'_X',xxx,’_’,yy,’db';]); 
dddd2(  1  ,y)=eval(('max_TR_X',xx,'_X',xxx,’_',yy,’db’;l); 
eeee2(  1  ,y)=eval(['niax_BR_X',xx,'_X',xxx,'_'.yy,’db’;l); 
end 
end 


Cll:  Program  BIG.summer.M 

%  BIG.summer; 

%  This  program  finds  the  sum  of  all  plot  variables 

for  loopl=l:3; 
for  loop2=l:10; 
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adder.iKloopI  .Ioop2)sb(loop  I  .loqp2H«lder_b(loopl  .loop2): 

adder.cOoop  1  ,loop2)«c(loopl  Joop2H«(ld<sr_c(loopl  ,Ioop2); 

a<lder_d(loopl.loop2)«d(loopl.Ioop2Ha<lder_<l(loopl.loop2); 

adder.eOoop  1  .Ioop2)ae(loopl  .lo<^2)+adder_e(loopl  .loop2); 

adder.b  1  (loopl  ,loop2)sbl  (loopl  .Ioop2Hadder_bl  (loopl  .loop2); 

adder_cl(loopl.loop2)«cl(loopUoop2Hadder_cl0o<^l.loop2): 

adder_dl(Ioopl.loop2)sdl(loopt.loop2Hadder_dl0oopUoop2); 

adder_el(loopl.loop2)sel(lo<9ljoop2)+adder_el0oopl.loop2); 

adder_b2(loopl,loop2)sb2(loopl.loop2)-t-adder_b2(loopl.loop2); 

adder_c2(loopl  .loop2)sc2(loopl  .loop2H«(lder_c20oopl  ,loop2); 

adder_d2(]oopl  ,loop2)s:d2(loopl  .loop2H«dder_d2(loopl  .loop2); 

adder_e2(loopl  ,Ioop2>re2(loopl  .loop2)-»-adda'_e2(Ioopl  ,loop2); 

end 

end 

for  loop3=l:2; 
for  loop43l:10; 

adder_bb0oop3.1oop4)=bb(loop3.loop4>t-adder_bb(loop3,loop4): 
adder_ccOoop3,Ioop4)=cc(loop3,loop4)+adder_cc(1oop3,loop4); 
adder_dd(loop3.1oop4)sdd(loop3.1oop4)>t-adder_dd(loop3.1oop4); 
adder_ee0oop3,loo^>=ee(Ioop3,loop4)+a(kter_ee(loop3,loop4); 
adder.bb  1  (loop3,loo(^)=bb  1  (loop3,loop4Hadder_bb  1  (loop3,loop4); 
adder_ccl(loop3,loo^)=ccl(loop3,loop4)+adder_ccl0oop3,loop4); 
adder.dd  1  (Ioop3,loop4)=dd  1  (Ioop3,]oop4)<f  adder.dd  1  (Ioop3,loop4) ; 
adder_eel(loop3.1oo^]^eel(loop3,looi^Hadder_eel(loop3.]oop4); 
adder_bb2(loop3.1oop4)=bb2(loop3,loop4)'»-adder_bb2(loop3,loop4); 
adder_cc2(Ioop3,loo^;Ncc2(Ioop3,Ioo(^Hadder_cc2(Ioop3,loop4); 
adder_dd2(Ioop3.1oop4)=dd2(loop3,]oop4)-i-adder_dd2(Ioop3,loop4); 
adder_ee2(loop3,loo^>=ee2(loop3,loop4)+adder_ee2(loop3,loop4); 
end 
end 

for  loopS=l:l; 
for  Ioop6=l:10; 

adder_bbb(IoopS,loop6)=bbb(loop5,ioop6Hadder_bbb(loopS,loop6); 
adder_ccc(loop5,loop<5)=ccc(loop5,loop6)+adder_ccc(loop5,loop6); 
adder_ddd(loopS,loop6)=ddd(loop5,loop6>i-adder_ddd(loopS,loop6); 
adder_eee(loop5,loop6)=eee(loop5,loop6)+adder_eee(loop5,loop6); 
adder_bbb  1  (loop5  ,loop6)=bbb  1  (loops  ,loop6)-i-adder_bbb  1  (loopS  .Ioop6) ; 
adder_ccc  1  (loops  ,loo^)=ccc  10oopS.loop6)+adder_ccc  l(loopS,Ioop6); 
adder_dddl(IoopS,Ioop6)=dddl(IoopS.Ioop6)'i-adder_dddl(IoopS,looi^); 
adder_eee  1  (loopS  ,loo^)=eee  1  (loopS,loop6)+adder_eee  l(IoopS,loop6); 
adder_bbb2(IoopS,loop6)=bbb2(IoopS.loop6Hadder_bbb2(loopS,loop6); 
adder_ccc2(loopS  ,loo]^)=ccc20oopS  ,loop6)4-adder_ccc2(loop5  ,loop6); 
adder_ddd2(loopS  ,loop6)=ddd2(loopS  ,Ioop6Hadder_ddd2(IoopS  .Ioop6) ; 
adder_eee2(loopS,loop6)=eee2(loopS.loop6)+adder_eee2(loopS,loop6); 
end 
end 

for  Ioop7=l:l; 
for  loop8=l:10; 

adder_bbbb(loop7,loop8)=bbbb(loop7,loop8)+adder_bbbb(loop7,Ioop8); 

adder_cccc(loop7,Ioop8)=cccc(loop7.1oop8)+adder_cccc(loop7,loop8); 

adder_dddd(loop7,loop8)=dddd(loop7,loop8)+adder_dddd(loop7,loop8); 

adder_eeee(loop7,loop8)=eeee(loop7,loop8)+adder_eeee(loop7,loop8); 
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a(Wer_bbbbl(loop7,Ioop8)=bbbbl(loop7,loop8)+adder_bbbbl(loop7,Ioop8); 

adder.cccc  1  (loop7,loop8)=ccccl  (loop7,loop8)+adder_cccc  l(loop7,loop8); 

adder.ddiki  1  (Ioop7.1oop8)=dddd  1  (Ioop7,loop8)+adder_dddd  1  (loop7.1oop8) ; 

adder_eeee  1  (Ioop7,Ioop8)=eeee  1  (loop7,loop8)+*dder_eeee  1  (loop7,loop8); 

adder_bbbb2(loop7,loop8)=bbbb2(loop7,loop8)+adder_bbbb2(loop7,loop8); 

adder_cccc2(Ioop7,loop8)=cccc2(loop7,loop8)+adder_cccc2(Ioop7,Ioop8); 

adder_dddd2(loop7,loop8)sdddd2(loop7.Ioop8Kadder_dddd2(loop7,loop8); 

adder_eeee2(loop7  ,loop8)=eeee2(loop7,loop8)+adder_eeee2(loop7,loop8) ; 

end 

end 

clear  b  c  d  e  bl  cl  dl  el  b2  c2  d2  e2  bb  cc  dd  ee  bbl  ccl  ddl  eel 
clear  bb2  cc2  dd2  ee2  bbb  ccc  ddd  eee  bbbl  cccl  dddl  eeel 
clear  bbb2  ccc2  eee2  ddd2  bbbb  cccc  dddd  eeee  bbbbl  ccccl  ddddl  eeeel 
clear  bbbb2  cccc2  dddd2  eeee2 


C.12:  Program  BIG_var_save.M 

%  THIS  PROGRAM  WILL  SAVE  ALL  IMPORTANT  VARIABLES  % 


eval(['save  GRAPH_',mark,'  loopy  adder_b  adder_c  adder_d  adder_e  adder_bl  adder_cl 
adder_dl  adder_el  adder_b2  adder_c2  adder_d2  adder_e2  adder_bb  adder_cc  adder.dd 
adder_ee  adder_bbl  adder_ccl  adder_ddl  adder_eel  adder_bb2  adder_cc2  adder_dd2 
adder_ee2  adder.bbb  adder_ccc  adder_ddd  adder_eee  adder_bbbl  adder_cccl  adder_dddl 
adder_eeel  adder_bbb2  adder_ccc2  adder_ddd2  adder_eee2  adder_bbbb  adder_cccc 
adder_dddd  adder_eeee  adder_bbbbl  adder_ccccl  adder_ddddl  adder_eeeel  adder_bt>l>l>2 
adderlcccc2  adder_dddd2  adder_eeee2']); 


if  loopy— 1 

eval(['save  RUNJ.mark,'  XI  Odb  XI  Idb  Xl_2db  Xl_3db  Xl_4db  Xl_5db  Xl.lOdb 
%Xl_15db  Xl_20db  X2_0db  X2_ldb  X2^2db  X2_3db  X2_4db  X2_5db  X2_10db 

X2_15db  %X2_20db  X3_0db  X3_ldb  X3_2db  X3_3db  X3_4db  X3_5db  X3_10db 

X3_15db  X3_20db']); 

elseif  loopy==20 

eval(['save  RUNJ.mark,’  Xl.Odb  Xl.ldb  Xl_2db  Xl_3db  Xl_4db  Xl_5db  Xl.lOdb 
%Xl_15db  Xl_20db  X2_0db  X2_ldb  X2  2db  X2_3db  X2_4db  X2_5db  X2_10db 

X2_15db  %X2_20db  X3_0db  X3_ldb  X3  2db  X3_3db  X3_4db  X3_5db  X3_10db 

X3_15db  X3_20db']); 

elseif  loopy==40 

eval([*save  RUNJ.mark,'  Xl_Odb  Xl.ldb  Xl_2db  Xl_3db  Xl_4db  Xl_5db  Xl.lOdb 
%Xl_15db  Xl_20db  X2_0db  X2_ldb  X2_2db  X2_3db  X2_4db  X2_5db  X2_10db 

X2_15db  %X2_20db  X3_0db  X3_ldb  X3_2db  X3_3db  X3_4db  X3_5db  X3_10db 

X3_15db  X3_20db']); 

elseif  loopy==40 

eval((’save  RUNJ.mark,’  Xl_Odb  Xl.ldb  Xl_2db  Xl_3db  Xl_4db  Xl_5db  Xl.lOdb 
%Xl_15db  Xl_20db  X2_0db  X2_ldb  X2_2db  X2_3db  X2_4db  X2_5db  X2_10db 

X2_15db  %X2_20db  X3_0db  X3_ldb  X3_2db  X3_3db  X3_4db  X3_5db  X3_10db 

X3_15db  X3_20db’]); 

elseif  loopy==60 
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evald’save  RUNJ,mark.*  Xl.Odb  XI  Idb  Xl_2db  Xl_3db  Xl_4db  Xl_5db  Xl.lOdb 
%X1  15db  XI  20db  X2_Odb  X2_ldb  X2_2db  X2_3db  X2_4db  X2_5db  X2_10db 

X2  15db  %X2  20db  X3_Odb  X3_ldb  X3_2db  X3_3db  X3_4db  X3_5db  X3_10db 

X3_15db  X3_20db’]); 

elseif  loopyssSO 

eval(['save  RUNJ.mark,'  Xl_Odb  Xl.ldb  Xl_2db  Xl_3db  Xl_4db  Xl_5db  Xl_10db 
%Xl_l5db  XI  20db  X2_Odb  X2_ldb  X2_2db  X2_3db  X2_4db  X2_5db  X2_10db 

X2_15db  %X2_20db  X3_Odb  X3_ldb  X3_2db  X3_3db  X3_4db  X3_5db  X3_10db 

X3_15db  X3_20db’]); 

elseif  loopysslOO 

evaUl'save  RUN_',mark.'  Xl_Odb  Xl.ldb  Xl_2db  Xl_3db  Xl_4db  Xl_5db  Xl.lOdb 
%Xl_15db  XI  20db  X2_0db  X2  Idb  X2_2db  X2_3db  X2_4db  X2_5db  X2_10db 

X2_15db  %X2_20db  X3_Odb  X3_ldb  X3_2db  X3_3db  X3_4db  X3_5db  X3_10db 

X3_15db  X3_20db’]); 

end 

eval(['save  PLACE_MARK  mark']); 


C13:  Program  BIG_average.M 

%  BIG.average 

^t****************************************************** 

%  This  program  takes  the  average  for  the  plots 

^*0t*«00^t^t*00t************************0*************** 

b»adder  _bAoopy ; 
c=adder_c/loopy; 
dsadder.d/Ioopy; 
e=adder_e/loopy; 
b  1  =adder_b  1  Aoopy ; 
c  l=:adder_c  1  Aoopy ; 
d  1  =adder_d  1  Aoopy ; 
e  l=adder_e  1  Aoopy ; 
b2=adder_b2Aoopy; 
c2=adder_c2/Ioopy; 
d2=adder_d2Aoopy; 
e2=adder_e2/Ioopy; 

bb=adder_bbAoopy; 
cc=adder_cc/loopy; 
dd=adder_dd/Ioopy; 
ee=adder_ee/loopy; 
bb  1  =adder_bb  1  Aoopy ; 
cc  1  =adder_cc  1  Aoopy ; 
dd  1 =adder_dd  1  Aoopy ; 
ee  1 =adder_ee  1  Aoopy ; 
bb2=adder_bb2/loopy; 
cc2=adder_cc2/loopy; 
dd2=adder_dd2/Ioopy; 
ee2=adder_ee2  Aoopy ; 


126 


bbbsadder.bbb/loopy; 
cccsaddCT.ccc/loi^y; 
ddd«8dder_ddd/loopy; 
eeesadder.eee/loopy; 
bbblsadder.bbblAoopy: 
ccc  1  «adder_ccc  1 /loopy ; 
ddd  1  sadder_ddd  1 /loopy ; 
eeelsadder_eee  1/loopy; 
bbb2sadder_bbb2/loopy ; 
ccc2sadder_ccc2/loopy; 
ddd2sadder_ddd2/Ioopy ; 
eee2s:adda’_eee2/Ioopy; 

bbbbsadder_bbbb/loopy ; 
ccccsadder.cccc/loopy; 
ddddsadder_dddd/loopy; 
eeee=adder_eeee/loopy ; 
bbbb  1  sadder.bbbb  1  /loopy ; 
cccclsadder_cccc  1/loopy; 
dddd  1  sadder_dddd  1/loopy ; 
eeeelsadder.eeee  1/loopy; 
bbbb2=adder_bbbb2/loopy; 
cccc2=adder_cccc2/loopy; 
dddd2s=adder_dddd2/loopy; 
eeee2=adder_eeee2/loopy; 


C.14:  Program  BIG_plots.M 

%  BlG_plots; 

gf,  ««***«****4>*«*««****4i*«4.4.*4i****************** 

%  THIS  PROGRAM  CALCULATES  AND  PLOTS  CURVES 
%  BASED  ON  RESULTS  FROM  THE  CORRELATIONS 

gf,  **  *****41  *«***«4>***«**4.4,**«*««******4i  ********* 

range=[0  -1-2-3-4-5-10-15  -20]; 

db_len=2:10; 

xrange=-20:0; 

yrange=ones(1.21); 


bandsones(l,5); 

rangel=[0  -1  -2  -3  -4  -5  -10  -15  -20]; 
range2=[0  -1-2-3-4-5-10-15  -20]; 
range3=t0  -1  -2  -3  -4  -5  -10  -15  -20]; 

%range2=[-.33  -1.33  -2.33  -3.33  -4.33  -5.33  -10.33  -15.33  -19.33]; 
%range3=[-.66  -1.66  -2.66  -3.66  -4.66  -5.66  -10.66  -15.66  -19.66]; 

%  THIS  PLOTS  X1,X2,X3  with  themselves  for  Rone-20db 
%  for  normalized  cross  coorelation  (1st  plot) 

%UR 

cig 

hold  off; 
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^  ••****•««•********«****•••«•*••******•*******«*«****«* 
%  PLOT  SET  #1  -XI  w/  Xr  &  "X2  w/  X2"  &  "XS  w/  X3" 

^  *•*«*************«******•*******•****•*•******•****«**< 

%%%%%%Cross  Cocrdation  Plots  w/  DC  Effects  %%%%% 

%PLOT»l  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
subplot(221) 

axis  ([-20  0  0  1]) 
plot(range,b(  1  .dbjen),’-'); 
hold  on; 

pIot(xrange.(b(  1 , 1  )*yrange),’-’); 

pk>t(range.b(2.dbJen).'-‘); 
pIot(xrange,(b(2. 1  )*yrange).'--'); 

plot(range,b(3.dbJen).':'); 
plot(xrange.(b(3. 1  )*yrange),' 
text(- 1 1  ..4.'_=X  1_X  l#db) 
text(- 1 1  ,.3.*— *X2_X2#db’) 
text(-l  1..2,'...=X3_X3#db) 

%text(-8..1. 'Straight  line  =  no.noise  level') 

titie('Cioss  Corr.') 

xlabel('dB') 

ylabelCCorr.  Coef.') 

hold  off 

%PLCmt2  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(222) 

axis  ([-20  0  0  1]) 

plot(range,b(  1  ,db_len),'-'); 

hold  on; 

plot(xrange,(b(  I .  I  )'*yrange),'-'); 
for  loop=l:9; 

plot(band*range  1  (loop).linspace(b  I  ( I  ,loopf  I).b2(  1  ,loop+ 1  ),S)); 
end 

text(-9,.3,'XI_Xl#db') 

%text(-8,.l, 'Straight  line  =  no.noise  level') 

tideCXl  Bantf) 

xlabel('dB') 

ylabelCCorr.  Coef.') 

hold  off 

%PLOTW3  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(223) 

axis  ([-20  0  0  1]) 

plot(range,b(2,dbJen),'--'); 

hold  on 

plot(xrange.(b(2, 1  )*yrange).'-'); 
for  loops  1:9; 

plot(band*range2(loop),)inspace(b  1  (2,loopf  l),b2(2,loq>+ 1  ),5),'--'); 
end 

text(-19,.8.'X2_X2#db') 

%text(-8,.l, 'Straight  line  s  no_noise  ieveO 
Ude('X2  Band') 
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xlabelCdB) 
ylabelCCoir.  Coef.') 
hold  off 

%FL01M  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(224) 

axis  ([-20  0  0  1]) 

plot(range,b(3.db_Ien),':'); 

hold  on 

plot(xrange,(b(3. 1  )*yrange),*:’); 
for  loops  1:9; 

plot(band*range3(loop).linq)«ce(b  l(3.lo(^l  ).b2(3.loop4- 1  ),5),’:'); 
end 

tcxt(-19..8.X3_X3#db’) 

%text(-8,.l. 'Straight  line  =  no_noise  level') 

UUe('X3  Band') 
xlabel('dB') 
ylabelCCoir.  Coef.') 
hold  off 

%text(0.3,0.'  EACH  TEMPLATE  COMPARED  WITH  ITSELF  WITH  NOISE  ','sc') 
pause 

%%%%%%%  Cross  Correlation  Plots  w/no  DC  effects  %%%%%%% 

%PLOT»l  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

%  THIS  PLOTS  X1^2.X3  with  themselves  for  none-20db 
%  for  NORMALIZED  CROSS  CORRELATION  COEFHCIENT  (2nd  plot) 

%RR 

clg 

subplot(221) 
axis  ((-20  0  0  1]) 

plot(range,c(  1  .dbjen),'-'); 
hold  on 

plot(xrange,(c(  1 , 1  )*yrange),'-'); 

ploKrange,c(2,db_len),'-'); 
plot(xrange,(c(2. 1  )*yrange),'-'); 

plot(range,c(3,dbJen),':'); 
pIot(xrange.(c(3, 1  )'*yrange),':'); 

text(- 1 1  ,.4,'_=X  1_X  l#db') 
text(-l  1,.3,'— =X2_X2#db') 
text(-l  l,.2.'...=X3_X3#db') 

%text(-8,.l, 'Straight  line  =  no_noise  level') 

dtleCC^ross  Corr.(no  mean)') 

xlabel('dB') 

ylabelCCoir.  Coef.') 

hold  off 

%text(0.3,0,'  EACH  TEMPLATE  COMPARED  WITH  ITSELF  WITH  NOISE  '.'sc') 

%PLOT«2  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
subpIot(222) 

axis  ([-20  0  0  I]) 
pIot(range,c(  1  .dbjen),'-'); 
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hold  on; 

ploKxraiige.(c(  1 . 1  )*yraiige).'-'); 
for  loopKl;9; 

Idoc(band*raiigel(loop),liQspKe(cl(lJoop4-l)x2(l,loop^l)^)); 

end 

te]it(-9..3.’Xl_Xlidb') 

%iext(-8,.l.'Straiglit  Une  >  no.noise  level*) 

dtleCXl  Band*) 

xlabel('dB') 

ylabdCConr.  Coef.') 

hold  off 

%PLOr[W3  %%%%%%%%%%%%%%%%%%%%%%%%%%*%%%%%%%%%%% 
sub|riot(223) 

axis  ((-20  0  0  1]) 
plot(range,c(2.db_len).'»'); 
hold  on; 

plot(xrange.(c(2. 1  )*yrange),'“'); 
for  Ioop>l:9; 

ploUl>and*range  1  (loop),linspace(c  I  (2,lo(^  l),c2(2  Joop4- 1 
end 

text(-19,.8.*X2_X2#db) 

%text(-8..1, ‘Straight  line  »  no.noise  level*) 

titleCX2  Band*) 

xlabel(*dB') 

ylabel(*CoiT.  Coef.*) 

hold  off 

subplot(224) 

axis  ((-20  0  0  I]) 
plot(range.c(3.dbJen).':'); 
hold  on; 

plot(xrange,(c(3, 1  )*yrange);;*) ; 
for  loopsl:9; 

plot(band*range  l(loop),linspaoe(c  I  (3.1oop4-  l)x2(3.lo<^  I  ).5),';'); 
end 

text(.19..8.*X3_X3#db') 

%text(-8,.l, ‘Straight  line  =  no.noise  level*) 

tiUe(*X3  Band*) 

xIabelCdB') 

ylabelCCorr.  Coef.') 

hold  off 

pause 

%%%%%%%  Bhattacharyya  distance  %%%%%%% 

%PLOT»i  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

%  THIS  PLOTS  Xl  JC2.X3  with  themselves  for  none-20db 
%  for  the  Bhattacharyya  distance  (4th  plot) 

%BR 

cig 

subplot(22l) 
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uis([-20  0  0  1]) 
subplot(221) 

(rto«[range,e(  1  .dbjen).'-'); 
hold  on 

plot(xrange.(e(  1 , 1  )*yringe),'-’); 

plot(range.e(2,dbJen),'-‘); 
plot(xrange.(e(2.1  )*yr*n8e).'*-'); 

plot(range,e(3.dbJen).';'); 
plot(xr8nge.(e(3. 1  )*yrangc).' 

text(-19,.8.’_=Xl_Xl#db’) 
text(-  19,.6;-=X2_X2#db’) 
text(- 19..  15.*..=X3_X3#db') 

%text(-8..2.'Straiglit  line  =  no.noise  level') 

titleCBhattacliaraya  dist') 

xlabel('dB') 

ylabel('Dlstance') 

hold  off; 

%text(0.3.0,'  EACH  TEMPLATE  COMPARED  WITH  ITSELF  WITH  NOISE  *.'sc  ) 
%PL01W2  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
subplot(222) 

axis  ([-20  0  0  1]) 
pIot(range,e(  1  .dbjen),'-'); 
hold  on; 

plot(xrange.(e(  1 , 1  )*yrange).'-’); 
for  loop=l:9; 

pIot(band*range  1  (Ioop).linspace(e  1  ( 1  ,{oop4- 1  ),e2(  1  ,Ioop+ 1 )  J)); 
end 

text(-19,.8.'Xl_Xl#db’) 

%text(-8,.l, 'Straight  line  =  no_noise  level') 

titleCXl  Band') 

xlabel('dB') 

ylabel('Distance') 

hold  off 

%PLOTIt3  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
subplot(223) 

axis  ([-20  0  0  1]) 
plot(range,e(2.db_len),'-'); 
hold  on; 

plot(xrange.(e(2, 1  )*yrange),'-'); 
for  loop=l:9; 

plot(band*range  1  (loop),linspace(e  1  (2,loopf  l),e2(2,loop+l )  J),'-'); 
end 

text(-19,.8.'X2_X2#db') 

%text(-8,.l, 'Straight  line  =  no_noise  level') 

meOa  Band') 

xlabel('dB') 

ylabel('Distance') 

hold  off 

%PLonm%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(224) 
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axis  ({-20  0  0  I]) 
plot(range.e(3.dbJeii).':'); 
hold  on; 

l4ot(xrange.(e(3. 1  )*yrange),':'): 
for  loops  1:9; 

plot(band*Tange  l(loop).Hn$pace(e  1  (3.1o(^  l)>e2(3  Jo(^  1 
end 

tcxt(-19..8.’X3_X3#db’) 

%text(-8..1. 'Straight  line  »  no.noise  level') 

title(’X3  Baud') 

xlabel('dB') 

ylabel('Distance') 

hold  off 

pause 

%%%%%%%%%%%%%  Divergence  %%%%%%%%%%%%%%% 

%PLCnwi  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

%  THIS  PLOTS  X1^2.X3  with  themselves  for  none-20db 
%  for  the  divergence  (3rd  plot) 

%TR 

clg 

subplot(221) 

plot(range,d(  1  .db_len),'-'); 
axis  ((-20  0  0  20]) 

hold  on 

plot(xrange.(d(  1 , 1  )*yrange),'-'); 

plot(rangc,d(2.dbJen),'"'); 
plot(xrange.(d(2, 1  )*yrange),'"') ; 

plot(range,d(3,dbJen),':'); 
plot(xrange,(d(3, 1  )*yrange),':'); 

text(-19,16.5.'_=Xl_Xl#db') 
text(- 19, 10,'— =X2_X2#db') 
text(-19,2.'...=X3_X3#db') 

%text(-12,12,'Straight  line  =  no.noise  levd') 

titieClXveigence') 

xlabel('dB') 

ylabel('Divergence') 

hold  off; 

%text(0.3,0,'  EACH  TEMPLATE  COMPARED  WITH  ITSELF  WLfH  NOISE  ’,'sc') 

%FU)Tff2  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(222) 

plot(range,d(  1  ,<fl)_len),'-'); 

axis  ((-20  0  0  20]) 

hold  on; 

plot(xrange,(d(  1 , 1  )*yrange),'-'); 
for  loops  1:9; 

plot(band*range  1  (loop),Unspace(d  1  ( 1  ,loop+ 1  ),d2(  1  ,loop+ 1  ),5)); 
end 

text(-19,17,'Xl_Xl#db') 
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%text(-8..1, 'Straight  line  =  no.noise  level') 

tiUeCXl  BaiKr) 

xlabeK'dB) 

ylabel('Divergence') 

hold  off 

%PLOTii3  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
subplot(223) 

plot(range,d(2,db_len),'-'); 

axis  (1-20  0  0  20]) 
hold  on; 

plot(xrange,(d(2, 1  )*yrange),'”'); 
for  loops  1:9; 

plot(band*rangel  (loop),linspace(d  1  (2,loop4-  l),d2(2,loop+ 1  ),S).'-'); 
end 

text(-19.17.'X2_X2#db') 

%text(-8,.l. 'Straight  line  =  no.noise  level') 

title('X2  Band') 

xlabel('dB') 

ylabel('Divergence') 

hold  off 

%PLOTH  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(224) 

pIot(range,d(3.db_len),':'); 

axis  ([-20  0  0  20]) 

hold  on; 

plot(xrange,(d(3, 1  )'*yrange),':'); 
for  loops  1:9; 

plot(band*range  1  (loop),linspace(d  l(3,loop4- 1  ),d2(3,loop+ 1  ),5),':'); 
end 

text(-19,17.'X3_X3#db') 

%text(-8,.l, 'Straight  line  =  no_noise  level') 

titie('X3  Band') 

xlabel('dB') 

ylabel('Divergence') 

hold  off 

pause 

^  t0tt*************************************************** 

%  PLOT  SET  #2  "XI  w/  XI"  &  "XI  w/  X2"  &  "XI  w/  X3" 

^  ^.0^i1,*000m**0*00**«**1,*****  ***************************** 

%%%%%%Cmss  Correlation  w/DC  %%%%%%%% 

%PLOT#l  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

clg 

Cl3 

subpIot(221) 


%UR 

pIot(range,b(  1  .dbjen),'-'); 
axis  ([-20  0  0  1]) 
hold  on; 

plot(xrange,(b(  1 . 1  )*yrange),'-'); 
plot(range,bb(  1  .dbjen),'-'); 
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l4ot(xraBge,(bb(  1 . 1  )*yrtage).'--'); 


plot(ru4e.bl>b(  1  .dbjen).':'); 
plot(xnuige,(bbb(  1 . 1  )*yrange),':'); 

iext(-  19,.8.*_=X  1  _X  l#(lb') 
text(- 19..7.*— Xl_X2#<Ib') 
text(-19..6.':  =Xl_X3#db') 

%text(-19,.7, 'Straight  line  »  no_noise  level') 

titleCCioss  Con.') 

xiabeK'dB') 

ylabeK'Cwr.  Coef) 

hold  off', 

%text(0.35,0,'  XI  TEMPLATE  COMPARED  WITH  X2  AND  X3  '.'sc') 
subplot(222) 

plot(range,b(  1  .dbjen),'-'); 
axis  ([-20  0  0  1]) 

hold  on; 

plot(xrange.(b(  1 , 1  )*yrange),’-'); 
for  loops  1:9; 

plot(band'*range  1  (loop).linspace(b  1  ( 1  ,loop4- 1  ),b2(  1  .loop^- 1  ),S)); 
end 

text(-9..3.'Xl.Xl#db') 

%text(-8,.l, 'Straight  line  s  no  noise  level') 

dtleCXl  Band  ) 

xlabel(’dB') 

ylabeK'Corr.  Coef.') 

hold  off 

%PLO'IW3  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(223) 

cla 

plot(range.bb(  1  .dbjen),'-'); 
axis  ([-20  0  0  1]) 

hold  on 

plot(xrange,(bb(  1 , 1  )*yrange).'-'); 
for  loops  1:9; 

plot(band*range  1  (loop).Unspace(bb  1  ( 1  .loopf  1  ),bb2(  1  ,loop+ 1  ),S).'-'); 
end 

text(-19,.7,'Xl_X2#db') 
tide('X2  Band') 
xlabel('dB') 
ylabelCCorr.  Coef.') 
hold  off 

%PLOT#4  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
subplot(224) 

cin 

axis  ([-20  0  0  1]) 
plot(range,bbb(  1  .dbjen),':'); 
axis  ([-20  0  0  1]) 
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hold  on 

pIot(xrange,(bbb(  1 . 1  )*yrange),*;'); 
for  loop=l:9; 

ldot(band*range  1  (Ioop).linspace(bbb  1  ( 1  ,Ioo{H-  1  ),bbb2(  I  .loop+ 1  ).S),' 
end 

text(-19..7.*Xl_X3#db') 
tiUeCXS  Band') 
xlabel('dB') 
ylabelCCoir.  Coef.') 
hold  off 
pause 

%  THIS  PLOTS  XI  W/X2  &  XI  w/  X3  for  none-20db 
%  for  the  cross  correlation  (2nd  plot) 

%RR 

%%%%%  Cross  Correlation  w/o  DC  %%%%%% 

%PLOT»l  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
clg 

subpIot(221) 

plot(range,c(  1  .dbjen),'-'); 
axis  ([-20  0  0  1]) 
hold  on; 

plot(xrange,(c(  1 . 1  )*yrange),'-'); 

plot(range.ccc(  1  .dbjen),’:'); 
plot(xrange,(ccc(  1 , 1  )*yrange),’:'): 

plot(range.cc(  1  ,db_len), '--'); 
plot(xrange,(cc(  1 , 1  )*yrange),'"'); 

text(-19..8,'_=Xl_Xl#db') 
text(- 19..7.’-=X  l_X2#db') 
text(-19,.6,’:  =Xl_X3#db') 

%text(-19,.7,’Straight  line  =  no_noise  level') 

titleCCross  Corr.  (no  mean)') 

xlabel('dB') 

ylabeK'Mean  Value') 

hold  off; 

%text(0.35,0.’  XI  TEMPLATE  COMPARED  WITH  X2  AND  X3  ’.’sc  ) 

%PLOTW2  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
subplot(222) 

plot(range,c(  1  .dbjen),'-'); 
axis  (1-20  0  0  1]) 

hold  on; 

plot(xrange,(c(  1 .1  )*yrange).'-'); 
for  loop=l:9; 

plot(band*range  1  (Ioop),linspace(c  1  ( 1  ,loop+ 1  ),c2(  1  ,loop+ 1  ),5)); 
end 

text(-9..3,’Xl_Xl#db') 

%text(-8,.l, 'Straight  line  =  no_noise  level') 
tiUeCXl  Band') 
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xlabel('dB') 
ylabeK'Corr.  Coef.’) 
hold  off 

%PLOT(»3  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(223) 

cla 

plot(range,cc(  1  ,db_Ien),'--’); 
axis  ([-20  0  0  1]) 

hold  on 

pIot(xrange.(cc(  1 . 1  )*yrange).’"'); 
for  loop=l;9; 

plot(band*range  1  (Ioop),linspace(cc  1  ( 1  ,loop4- 1  ),cc2(  1  ,loop^  1  ),5 
end 

text(-l9..7.’Xl_X2#db') 
titieCX2  Band') 
xlabel('dB') 
ylabeK'Corr.  Coef.') 
hold  off 

%PLOTM  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(224) 

cla 

plot(range,ccc(  1  ,db_len),';'); 
axis  ([-20  0  0  1]) 

hold  on 

plot(xrange,(ccc(  1 , 1  )*yrange).':'); 
for  loop=l:9; 

plot(band*rangel  (loop),linspace(ccc  1(  1  ,loop+ 1  ),ccc2(  1  ,loop+ 1  ),5),’:'); 
end 

text(-19..7.'Xl_X3#db') 

tiae('X3  Band') 
xlabel('dB') 
ylabeK'Corr.  Coef.') 
hold  off 
pause 

%  THIS  PLOTS  XI  w/  X2  &  XI  w/  X3  for  none-20db 
%  for  the  Bhattacharyya  distance  (4th  plot) 

%BR 

%%%%%%%Bhattacharyya  distance  %%%%%%%%%%% 

%PLOT»l  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
clg 

subplot(221) 
pIot(range,e(  1  .dbjen),'-') ; 
axis  ([-20  0  0  1]) 

hold  on; 

plot(Xi  ange,(e(  1 , 1  )*yrange),'-’); 

plot(range,eee(  1  ,db_len),' :'); 
plot(xrange,(eee(  1 . 1  )*yrange),';'); 

plot(range,ee(  1  ,db_len),'-'); 
plot(xrange.(ee(  1 . 1  )*yrange),'-'); 
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text(-  19,.9.'_=X  1_X  l#db’) 
text(-  19,.8.'-=X  l_X2#db') 
text(-19..7.’:  =X1_  X3#db’) 

%text(-19,.4S.'Straight  line  =  no_noise  level') 

tiUe('Bhattacharyya  dist ') 

xlabel('dB') 

ylabel('Distance') 

hold  off; 

%text(0.35,0.'  XI  TEMPLATE  COMPARED  WITH  X2  AND  X3  '.'sc') 

%PLX)TW2  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
subplot(222) 

plot(range.e(  1  .dbjen),'-') ; 
axis  ([-20  0  0  1]) 

hold  on; 

plot(xrange.(e(  1 , 1  )*yrange).'-'): 
for  loops  1:9; 

pIot(band*range  1  (loop),Iinspace(e  1  ( 1  ,loop+ 1  ),e2(  1  ,loop+ 1  ),5)) ; 
end 

text(-17,.8,'Xl_Xl#db') 

%text(-8,.l, 'Straight  line  =  no_noise  level') 

tideCXl  Band') 

xlabel('dB') 

ylabel('Distance') 

hold  off 

%P1jOJW3  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(223) 

cla 

plot(range,ee(  1 , dbjen),'-'); 
axis  ([-20  0  0  1]) 
hold  on 

plot(xrange,(ee(  1 , 1  )*yrange),'-'); 
for  loops  1:9; 

plot(band*range  1  (loop),li  nspace(ee  1  ( 1  ,loop+ 1  ),ee2(  1  ,loop+ 1  ),5 ),'-’); 
end 

text(-17,.7.'Xl_X2#db') 
tiUe('X2  Band') 
xlabel('dB') 
ylabel('Distance') 
hold  off 

%PLOT#4  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(224) 

cla 

plot(range,ee(2,db_len),':'); 
axis  ([-20  0  0  1]) 

hold  on 

pIot(xrange,(eee(  1 , 1  )*yrange).':'); 
for  loops  1:9; 

plot(band*range  1  (loop),linspace(eee  1  ( 1  .loop^- 1  ),eee2(  1  ,loop+ 1  ),5),' : ') ; 
end 

text(-17,.7,'Xl_X3#db') 
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titteCX3  Band') 
xlabel('dB') 
ylabel('Dlstance') 
hold  off 
pause 

%  THIS  PLOTS  XI  w/  X2  &  XI  w/  X3  for  iione-20db 
%  for  the  (Uvo'gence  (3rd  [Hot) 

%TR 

%%%%%  Divergence  %%%%%%%%%%%% 

%PLOT#l  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
clg 

subplot(221) 

clfl 

pIot(range,d(  1  .dbjen),’-’); 
axis  ([-20  0  0  20]) 

hold  on; 

plot(xrange,(d(  1 , 1  )*yrange),'-'); 

plot(range.ddd(  1  .dbjen),':'); 
plot(xrange.(ddd(  1 , 1  )*yrange),' :'); 

pIot(range,dd(  1  .dbjen),'-'); 
plot(xrange.(dd(  1 , 1  )*yrange),'-'); 

text(.  19, 17.'_=X  1_X  l#db') 
text(- 19, 14,'-=X  l_X2#db') 
text(-19,ll.':  =Xl_X3#db') 

%text(-19,6,'Straight  line  «  no.noise  level') 

titleCDivergence') 

xlabel('dB') 

ylabel('Divergence') 

hold  off; 

%text(0.35,0,'  XI  TEMPLATE  COMPARED  WITH  X2  AND  X3  ','sc') 

%PLOT«  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(222) 

cla 

plot(range,d(  1  ,db  Jen),'-'); 
axis  ([-20  0  0  20]) 
hold  on; 

pIot(xrange,(d(  1 , 1  )*yrange).'-'); 
for  loop=l:9; 

plot(band*rangel(loop),Iinspace(d  1  (1  .loopf  l),d2(  1  .Iooih-  1  ),5)); 
end 

text(-19,17,'Xl_Xl#db') 

%text(-8,.l, 'Straight  line  =  no.noise  level') 

tideCXl  Band') 

xlabel('dB') 

ylabel('Divergence') 

hold  o^ 

%PLO'm %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(223) 

cla 

plot(range,dd(  1  .dbjen),'-'); 
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axis  ([-20  0  0  20]) 


hold  on 

plot(xrange,(dd(  1 , 1  )*yrange).'-') ; 
for  loops  1:9; 

plo^band*range  I  (loop),Iinspace(ddl  ( I  .loopf- 1  ).dd2(  1  .ioopf  1  ),S),'-'); 
end 

text(-19.14,’Xl_X2#db’) 
tide('X2  Band') 
xlabel('dB') 
ylabel('Divergence') 
hold  off 

subplot(224) 

cin 

plot(range,ddd(  1  ,dbjen),':'); 
axis  ([-20  0  0  20]) 

hold  on 

plot(xrange,(ddd(  1 , 1  )*yrange).':'); 
for  loops  1:9; 

plot(band*range  1  (loop),linspace(ddd  1(1  ,loop4- 1  ),ddd2(  1  ,Ioopf  1  ),S).':') ; 
end 

text(-19.11,'Xl_X3#db') 

tiUeCXS  Band') 

xlabel('dB') 

ylabel('Divergence') 

hold  off 

pause 

clg 

%  PLOT  SET #3  ’'X2  w/  XI"  &  "X2  w/ X2"  &  "X2  w/  X3" 

%%%%%Cmss  Conelation  w/DC  %%%%%%%%%%% 

%PLOT#l  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
%UR 

subplot(221) 

plot(range.bbb(  1  ,db_len),':'); 
axis([-20  0  0  1]) 

hold  on 

plot(xrange,(bbb(  1 , 1  )*yrange),':'); 

plot(range,bbbb(  1  .dbjen),'-'); 
pIot(xrange,(bbbb(  1 , 1  )*yrange),'-'); 

plot(range,b(2,db_len),'-'); 
plot(xrange.(b(2, 1  )*yrange),'-'); 

text(-10,.2,':  =X2_  X34db') 
text(-19.5,.l,'_  =X2_Xl#db') 
text(-10,.  l,'-=X2_X2#db') 

%text(-14,.8, 'Straight  line  =  no_noise  level') 
title('Cross  Corr.  w/DC') 
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xlabeK'dB') 
ylabelCCoiT.  Coef.’) 
hold  ofT 

%FLCmi2%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subpIot(222) 

cla 

plot(range,bbbb(  1  .dbjen),'-'); 
axis((-20  0  0  1]) 

hold  on 

plot(xrange,(bbbb(  1 , 1  )*yrange).'-'); 
for  loops  1:9; 

plot(band*range  1  (loop).linspace(bbbb  1(  1  ,loop+ 1  ),bbbb2(  1  .loopf  1 )  J),'-’); 
end 

ddeCXl.Band) 
text(-19..8,’:  =X2_Xl#db’) 
xlabel('dB') 
ylabelCCorr.  Coef.') 
hold  off 

%PLCm3 %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(223) 

cla 

plot(range,b(2.dbJen), '--’); 
axis([-20  0  0  1]) 

hold  on; 

plot(xrange,(b(2, 1  )*yrange),’-'); 
for  loops  1:9; 

ploKband*rangel(loop),linspace(bl(2,loopt-l),b2(2,loop<»-l).5), '-•'); 
end 

tiUe('X2_Band') 
text(-19..8,':  =X2_X2#db') 
xlabel('dB') 
ylabelCCorr.  Coef.') 
hold  off 

%FU}'m  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(224) 

cla 

plot(range.bbb(  1  ,dbjen),':'); 
axis([-20  0  0  1]) 
hold  on 
for  loops  1:9; 

plot(band*range  1  (loop),linspace(bbb  1  ( 1  ,loop4- 1  ),bbb2(  1  ,loop+ 1  ).5 ),':'); 
end 

plot(xrange,(bbb(  1 , 1  )*yrange),':'); 

tiUe('X3_Band') 

text(-19,.8,':  =X2_X3#db') 

xlabel('dB') 

ylabelCCorr.  Coef.') 

hold  off 

pause 

cig 
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9bCioss  Condadon  w/no  DC  %%%% 

%PLcnwi  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
%UR 

subplot(221) 

cla 

plot(raiise.ccc(  1  .dbjen).':'); 
axis((-^0  0  1]) 

hold  on 

plot(xrange,(ccc(  1 , 1  )*yrange).*:'); 

plot(range,cccc(  1  ,db_len),'-'); 
plot(xrange.(cccc(  1 , 1  )*yrange),’-'); 

plot(range,c(2,dbJen),'“'); 
plot(xrange,(c(2, 1  )*yrange).'--'); 

text(-10..2.’:  =X2_  X3#db*) 
text(-19.5,.l,’_  =X2_Xl#db') 
text(- 1 0..  1  .•-=X2_X2#db*) 

%text(-17,.9,'Straight  line  =  no_noise  level') 

titte('Cross  Corr.(no  mean)') 

xlabel('dB') 

ylabeICCorr.  Coef.') 

hold  off 

%PLOT#2  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(222) 

cla 

plot(range,cccc(  1 , dbjen),'-'); 
axis([-20  0  0  1]) 

hold  on 

plot(xrange,(ccc(  1 , 1  )*yrange).':'); 
for  loop=l:9; 

plot(band*range  1  (loop),linspace(cccc  1  ( 1  ,loop4- 1  ),cccc2(  1  .loopf  1  ),S),'-'); 
end 

titte('Xl_Band') 
text(-19,.8.':  =X2_Xl#db') 
xlabel('dB') 
ylabeICCorr.  Coef.') 
hold  off 
%PLOT#3 

%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(223) 

cla 

plot(range,c(2,dbJen),'-'); 
axis([-20  0  0  1]) 

hold  on; 

plot(xrange,(c(2, 1  )*yrange).'-'); 
for  loops  1:9; 

plot(band*range  1  (loop).linspace(c  1  (2,loopf  1  ),c2(2,loop+ 1  ),S),'-'); 
end 
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titl«('X2_Band‘) 
icxt(-19..8.’:  =X2_X2#clb’) 
xlabelCdB') 
j^abelCCorr.  Coef.’) 

Ixdd  off 

%PLOT*4  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(224) 

cla 

|4ot(ranse.ccc(  1  ,db_len),';'): 
axis((-^0  0  1]) 
hold  on 
for  loops  1:9; 

plot(band*range  1  (Ioop).linspace(ccc  1  ( 1  .loopf  1  ),ccc2(  1  .loop+ 1 
end 

plot(xrange,(ccc(  1 , 1  )*yrange),’:'); 

title(*X3_Band*) 

tcxt(-19,.8.’:  =X2_X3#db') 

xlabeK'dB') 

ylabelCCorr.  Coef.') 

hold  off 

pause 


cig 

%Bhattacharyya  Distance  %%%%%%%%%%%%%%%%%%%%%%%%%%%% 
%PLOT#l 

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

%m 

subplot(221) 

cla 

plot(range,eee(  1  .dbjen),’:'); 
axis([-20  0  0  1]) 

hold  on 

plot(xrange,(eee(  1 , 1  )*yrange),':'); 

plot(range,eeee(  1  ,db_len),'-'); 
plot(xrange.(eeee(  1 , 1  )*yrange),'-'); 

pIot(range.e(2.dbJen),'-'); 
plot(xrange,(e(2, 1  )*yrange),'-'); 

text(-19,.9,':  =X2_  X3#db’) 
text(-19,.8,'_  =X2_Xl#db') 
text(-19,.7.'-=X2_X2#db*) 

%text(-14,.8,'Straight  line  »  no_noise  level') 

tideCBhattadiaryya  Distance') 

xlabel('dB') 

ylabel('Distance') 

hold  off 

%PLOTil2  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(222) 

cla 
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plot(ran8e.eeee(  1  .dbjen),'-'); 
axis([^0  0  ID 
twld  on 

|dot(xruige,(eeee(  1 . 1  )*yrange).'-'); 
for  loopBl:9; 

pk>t(band*range  l(loop).linspace(eeeel(  1  .loo|>f  1  ).eeee2(  1  Joop^- 1  ).S).'-'); 
end 

tltte(’Xl_B«nd') 
text(-19..8.’:  »X2_Xl#db*) 
xlabel('dB') 
yiabel(’Distance') 
bold  off 

%pixym  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(223) 

cla 

plot(ranse,e(2.dbJen),'--'); 
axisa-20  0  0  ID 

hold  on; 

plot(xrange.(e(2, 1  )*yrange), 
for  loop=l:9; 

plot(band*range  1  (loop),linspace(e  1  (2.loop4- 1  ),e2(2,loop+ 1  ),S),’-') ; 
end 

tiUeCX2_Band’) 
text(-19,.8.':  =X2_X2#db') 
xlabel('dB') 
ylabel('Distance') 
hold  off 

%PLOT»4  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
SUbplot(224) 

Cla 

pIot(range,eee(  1 , dbjen),':'); 
axis((-20  0  0  1]) 

hold  on 
for  loop=l:9; 

plot(band*range  l(loop),linspace(eee  1  ( 1  .loopf  1  ),eee2(  1  ,loop4- 1  ),S),':'); 
end 

plot(xrange,(eee(  1 , 1  )*yrange),';'); 

tiUe('X3_Band') 

text(-19,.8,':  =X2_X3#db') 

xlabel('dB') 

ylabel('Distance') 

hold  off 


pause 

clg 

%  Divergence 

%PLOT#l  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
%UR 

subplot(221) 

cla 

plot(range,ddd(  1  ,db_ien),':'); 
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•xlt([-20  0  0  20]) 
hold  on 

plot(xninge.(ddd(  1 . 1  )*yrange).':'); 

plot(nuige.dddd(  1  .(tt>_len).'-‘); 

^ot(xrange.(ddd^  1 . 1  )*yrange).'-'); 

I^t(nn8e.d(2.dbjen),'-'): 

plot(xnuige.(<K2. 1  )*yr»ngc),'-'); 

iext(-12.17,*:  »X2_  X3#tlb’) 
tcxt(-12,14,'_  =X2_Xl#db’) 
tcxt(-12.1  l.’-=X2_X2#db’) 

%text(-14..8,'Stnight  line  s  no.noise  leven 

dtleCDivefgence') 

xlabel('dB') 

ylabel('Divergence') 

hold  off 

%PL01W2  %%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 

subplot(222) 

cla 

plot(range.dddd(  1  .dbjen),'-'); 

«xis([-20  0  0  20]) 

hold  on 

pIot(xrange.(dddd(  1 , 1  )*yrange).'-'); 
for  loops  1:9; 

plot(band*range  1  Ooq[>).linspace(dddd  1(  1  .loop^- 1  ),dddd2(  1  .loopf  1  ),5)>'); 
end 

titieCXl.Band) 
text(-12,17,’:  sX2_Xl#db’) 
xlabel('dB') 
ylabel('Divergence') 
hold  off 

%%%%%%%%%%%%%%% 

%PLOT#3 

%%%%%%%%%%%%%% 

subplot(223) 

cla 

pIot(range.d(2.dbJen).'»'); 
axis([-20  0  0  20]) 
hold  on; 

pIot(xrange.(d(2, 1  )*yrange),'-'); 
for  loops  1:9; 

plot(band*rangel  (loop),linspace(d  1  (2,loop4- 1  ),d2(2,loop+ 1  ),5),'--’); 
end 

tide('X2_Band') 
text(-12,17.*;  sX2_X2#db') 
xlabelCdB') 
ylabel('Divergence') 
hold  off 

%%%%%%%%%%%%%%%% 

%PLCm4  %%%%%%%%%%% 
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sub(riot(224) 

cla 

plot(range,ddd(  1  .(Jb  Jen),':'); 
axis([-20  0  0  20]) 
hold  on 
for  loops  1:9; 

l^ot(band*range  1  (loop).linspace(ddd  1  ( I  .loopf  l).ddd2(  1  .loopf  1  ).5 
end 

plot(xrange,(eee(  1 , 1  )*yrange).':'); 
tiUeCX3_Band’) 
text(-12,17.’:  *X2_X3#db‘) 
xlabel('dB') 
ylabel('Divergence') 

%print  -deps  testl2 
hold  off 


C  NEURAL  NETWORK  INPUT  PROGRAMS 


C.15:  Program  NN_Setup.M  [8] 

^«4i**4i**4i*4i**4i**«*4i****«*************«**4i*************** 

%  NEURAL  NETWORK  INPUT  DATA  SET-UP 

^*4i4i***«4r**4t*4<4i***«*4i4i*4i****<|>****4i*****4.**it:****4>i|i******* 

%  version  1.2  2/2/94 

%(modifled  from  the  original  program  completed  by  Dr.  Monique  P.  Fargues) 

%  set  up  the  fourier  coefficients  for  nn  inputs 
%  6  coeffs/Iine  (iiqxit)  2  ouqxits;  set-up  for  SO  coefs 

countsinputCHow  many  times  do  you  want  to  run  this  program  *  '); 
for  loop^Lcount 
clear  X  x 

Q=I '  input  coef.  matrX3_no_noiseix  x(nlines,ncol) 

'  nlines:  number  of  fit  coefs  used ' 

'  ncol:  number  of  pulses  used']; 
disp(Q) 

FC=input('input  nn  coefs.  matrix  »  ','s');  %  x(nlines,ncol) 

X=eval(FC); 

XsX';  %  This  takes  the  transpose 
mat=[FC  ’.nna']; 

%  nlines:  nb  of  coefs 
%  ncol:  nb  of  pulses 
%  investigated 

%Ncol=input('number  of  fft  coefs  to  be  kept  (ie.  most  info,  in  30)  »  '); 

Ncol=30; 

%Q2=[  'choose  between  2  or  3  different  sets  to  train  the  NN  on']; 

Q2=[  This  program  will  use  2  different  s&s  to  train  the  NN  on']; 
disp(Q2) 


145 


%iset3inputCNuint)er  of  classes  »  '); 
iset«2; 


%iqptaii4Mt('Oass  of  tlie  pulse:  l(for  Xl#y2(for  X2#V3  '); 
iopt»lnput(‘Class  of  the  pulse:  l(for  XI#)  or  2(for  X2#)  or  3(for  X3*)  »  '); 
%rabsiq)ut(’U%  log  coefs  y/u:!^  »  ') 
idbsl; 


x«X(l  :Ncol.:);  %  restrict  to  the  desired  ob  of  fft  coefs 

[nliiies4icol]ssize(x); 

Nptssnliiies; 

N_linessflx(Npts/6) ;  %  6  sampesAine 

N_eiid=Npts-N_Uiies*6:  %  last  line 

%  anq^tude  normalization  of  the  pulses  need  for  NN 
%  normalize  power  in  X  pulses  to  1.  per  pulse. 

if  idb=l.x=10*log(x);end  %  choice  to  use  coefs  in  dB 

for  k_pulssl:ncol 
temp=sum(x(:,k_puls)); 

x(:.k_puls^x(:.k_puls)/temp; 

end 

%  set  up  for  bad  or  good  pulse  identification 
if  iset=2  %  test  fof  2  classes 

if  N_end=0, 

ifiopt==l,ref=['&  1  0M3];.  else.  ref=r&  0  lM31;end 
ClS6 

if iopt=l,ref=r  I  0M31;,  else,  ref=[’  0  r,13J;end 
end 

else  %  test  for  3  classes 

if  N_end==0, 

ifiopt=l,  ref=['&  10  0M3]; 
elseif  iopt=2,  ref=(’&  0  1  Of, 13]; 
elseif  iopt=3,  ref=['&  0  0  1M3];  end 
else 

ifiopt=l,  ref=['  10  0M3]; 
elseif  iopt=2.  ref=('  0  1  0M3]; 
elseif  iopt=3,  ref=['  0  0  r.B];  end 
end 
end 

%  output  data  per  pulse 
for  kp=l;ncoI 
%  first  line 

fprintf(mat.'%11.8f  %11.8f  %11.8f.x(l,kp),x(2,kp),x(3,kp)) 
fi)rintf(mat,’  %11.8f  %11.8f  %11.8An',x(4),x(5,kp),x(6.kp)) 

for  kl=l:N_lines-l 

fprintf(mat,’&  %1 1.8f  %1 1.8f  %1 1.8f,x(6*kl+l.kp),x(6*kl+2,kp).x(6*kl+3,kp)) 
fjrrintffmat,*  %11.8f  %11.8f  %1 1.8f\n’.x(6*kl+4,kp),x(6*kl+5,kp),x(6*kl+6,kp)) 
end 

if  N_end  ~=0  %  complete  for  the  last  line 

kl=N_lines 

if  N_end  >=  1,  fprintf(mat,'&  %11.8f,x(6*kl+l,kp));end 
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If  N_end  >=  2,  fpriittf(inat,'  %n.8f,x(6*kl-f2.iip)):eDd 
if  N_end  >»  3.  f^ntf(inat,'  %11.8f.x(6*ld-t-3,kp)):eixl 
if  N_end  >=  4.  f^iitf(inat.'  %11.8f.x(6*ki44Jcp));eDd 
if  Nlend  >=  5.  f^ntf(mat,'  %11.8f,x(6*kl+5.kp));end 
end 

fprintfCmaueO.  %  enter  ou4Mit  parameters 
end 

ciear  idb  iopt  iset  k_puis  ki  kp  mat  ncoi  niines  ref  temp  x 
clear  FC  N_end  NJines  Ncoi  Npts  Q  Q2 
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